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BRIEF METHOD OF EVALUATING TEST MATERIAL 


ISTANDING Tlie deve mment new tog) lt tect 
n the problem of determn y the difficulty of tes ms 
stumbling block to the construction of better sta rized 
\ hod ean sec t} it we eannot get awa eonsice 
ulty ot test agquestions 10! the vers practh that 
yno can answel h: ra questions are eommor sidered 
than those who ean only answer Casy Guestilons 
} ‘ nomted ¢ hv 7 +} } 
111 of (| ntrod wes more troubls 1 n 1 ol Viates A 
erates as a reward for those who get the question right and a 
I those who do not Our attention S usually centered upon 
d rather than the penalty It is perteet clear that a ehild 
sn QUESTION desel CS fi ‘| IST Lee is no 
ed when Thi¢ roe Wee ttached t} guest mn dded 


( When. however, a child misses th same question, we with- 


m h S seore the same amount as was added 1O the score ol the 
That sav, we pend ro t hye ad Who mISS@S 
ly hi liohtly far 
stion. Correspondingly, we yy ¢ him lehtiv tor missing 
For ] mul m t he first presi 
e United States, we may e expected > reduce our estimate ol 


in historv bv three points while we mav be ealled upon to 


our estimate twelve points because he cannot arrange ten events 
rder of their oceurrenee. This is absurd From the point ot 
penalty the child should lose more for failing on an easy ques 

or failing on a hard one. 
\ rently the best solution of this difficulty is to possess ourselves 
derable number of test items at each appropriate level of diffi 
Penalties and rewards may then be appropriately handled by 
uunting the number of items answered correctly at a given level 
mas be passed or failed at that level according to a formula 
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agreed upon—such as, *‘Pass a pupil at this level if he answe 
questions correctly 

In order to have a respectable number of questions, words 
lems at each significant level of difficulty in each subject, a vast 
body of test material will have to be evaluated than we now |} 
disposal. Moreover, as things are now, an investigator per! 
out two or three times as many items as he ultimately uses i 
or test The items which he does not use may he rejected 
intrinsie defects as to form or subject matter, but quite as fr 
they are rejeeted beeause they fail to fall within a convenient 
on a linear projection for difficulty, or because they have not 

. mitted to a sufficient number of children. In any event the n 
usually lost to the edueational world. 

There are three very good reasons why these conditions e: 
first has to do with the investigator, the second with his codper 

adi the third with the facilities for publishing his work. 

In the first place, the plain fact is that the evaluation of a larg 
of material is uninteresting, tedious, and expensive. It cannot 
with reference to tests as wholes. It must be done bv scoring se] 
each item, no matter how small, to which a response is madi 

|. If vou are evaluating analogies, it is not sufficient to obt 


pupil 


scores of ehildre non different groups of analogies, but you 0 
the scores on each individual analogy. More over, if you are de a : 
pupils of different grades, as is usually the case, the number at 
of correct answers to each question are not enough. A 40 pereen! 
on for the third grade means something quite different from a 4 
cent question for the fourth or fifth grade. Consequently, you 
of scoring must be such as to permit the computation of ** grad 
vals’’—that is, of the amount by which fourth-grade ability « 
third-grade ability, the amount by which fifth-grade ability e 
fourth-grade ability, and so on. These grade intervals are funet 
he scores of pupils. It therefore becomes necessary for you to 
plan for handling the returns so that you will get both questi 
and pupil-seores. 
The time-consuming character of this work is appalling. The 

has been made to feel this personally. For example, in the 
of words in spelling, he has found that an industrious and capal 
could not enter upon the necessary double-entry score sheets m: 


three classes of average size per day if she totaled and bala 
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word-scores When. therefore. one atte mpts to give each test 
as a hundred and fifty classes and tries to use fifteen or 
sts. each having as many as fifty words, he must live long or 
himself. 
second place, a diffieulty in the evaluation of test material 
m the natural reluctance of any but the most enthusiastic schoo! 
cooperate in the enterprise. School people want to know as 
, children do, not absolutely, but in comparison with other 
who have reacted to the same test. Only to a limited extent can 
gator who is merely evaluating new items furnish to the schools 


of information. 


he third place, not only is there a difficulty due to the tediousness 


nse of doing this sort of work and to the reluctance of school 


engage in it. but there is also the fundamental difficulty of 


» the publication of a report after ene has surmounted these diffi 


inere iS not a suffiei nt mand among reade re 


f educational 
for material of this sort It can only he offered in very long 
rate tables—tables which no publisher under present conditions 
to accept for printing in any considerable volume. 

t is certain that tables of this sort ought to be available The , 
regarded as source material or material for reference. In this 

hey would resemble such tables as are published by the United 

ensus Bureau. One uses such tables for the primary facets which 
in Moreover. one may combine these tacts in new ways, or 
ombine them with facts derived from other sources. Thus, one 

e up derived schedules or tables having certain meanings which 
no means apparent in the source material, This, of course, 1s 


e familiar notion in statistics in virtue of which we dis 


tween primary and secondary tables. It is probable that we 


ional foundat 


ions 


e to look to publie institutions or to eduea 
publication of primary tables of the sort we ar considering. The 
involved will no doubt prevent their publication in books or 
s which have to make ends meet 


standardization of test items suggest yet another problem. Sinee 


luation of data is so difficult is there not some shorter wa} of 


sing test items? We ordinarily think of a measuring device as 


for the purpose of determining the ability of pupils ; hut we 


think of it as a device to be used in the appraisal of other testing 


ching mate rials. The present article is cones rned with this pos- 
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the « frerenes d fficulty hetwee) 
ial to the inerement in read ne ability a 
en in each vear of the element: ry schoo! In othe 
sage appropriate to the typical reading 
pprop te to the reading 
en, ete Isn't it clear t] SCTIOS 
ed me to test but ilso to test reading 
( e not r mple, use it in selecting stories for a set of 7 
, on 1] Serve To Indleate wh: omeat 
I used not o1 to measure abilities but 
ut tI ! If the idea is valid, then it is obvious t 
( ti ibject matter mav in turn be used as test 
t Secu! r st re test data and that in this w t 
nt material of known difficulty may go on accumulath 
Vball rollin wil hill This IS perhaps an added reasol 
h wol rs should be buss about the accumulation of a r 
We ected and thorough \ ealibrat ad element 
eport relates to this entire question It rives an ace 
on in which test data were used in finding the diffi 
ta n ome. VO? the repor’ resents a short me 
iaterial and a eritieism o he 2ccuracyv of 
of two or three vears tl vriter made somet] , 
! lms by asking his friends, about twice a vear, t 
ts. He hopes they gained something of value from 


‘ hut he is sometimes harassed with doubts. Be that 


e obt ned by this species of inte lleetual brigandage a body of 1 
vi I heen personally useful, but which, for thi reasons i 
e, has not been put into print. 
(in one of these spelling tests returns were obtained from 4264 
eleven school systems. These pupils were about equally di 
tween tl ivth, fifth, and sixth grades. In other words, ab 


is ot these wrote the test It assumed 


4 
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Simpiieity, however, ippraisal IS | 
7 ted fo) nteresct r soelal ut tv or instrument 
nef ! nt he ed in estimating the importance of new materia 
\t present however. we re eonecerned with the anest 
cliffienlty 
Sy 
| 
{| 


rreet nes on each wor! iS 
to P. E. values, the true d each word. | 
immed that the true dif the 
obs tions made in thre COSS rane 
‘ The ble error of i! ent ] 
dren would not exeeed one tor one peree 
wher lel rom 1400 in « h of thre 
the Test STIONL CONSIST G5 Vo! 
eve fifth word, is given in order to show rt ti 
high, purchased, p , clothes, « 
In terms « ere rreet the « cultv of f 
s averaged 51 for the fourth grade, 66 for the 
SIXT 
e 50 words are, by our assu 
nown diffieult But r to u t} 
ty only with respect to the first 25 wo 1 
e shall regard the remaining 25 \y 0 
t US ¢ the first 25 tl mdardized dl nad 
letern ed words 
biem no s to find out the ¢ »>whie ‘ 
ndardized words to dete: ult t 


the files schools h; | nt ed t I] 
le in one these schoo ere called See By 


fore used from pup 
roblem may be thought of in 1 re specifie term re vritel 
} + of th ent 
+ ry il 
O745 
VN 
s found t spel ‘ 
¢ that the ch s are even t t 
I tv of the word is s not 
ed sic ly 
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tried to plaee himself in the position of the supe rintendent « ( 
who Was SUDDOS*t be in | ossession of the difficulty of 25 spellin 


which he had used for test purposes, and which he could no 


beeause of the tam arity oO the children with them suen 
tendent might be interested to secure, without going outside 

stem, a reasonal Vv aecural determination of the difficult 
words which he could subsequently use as test words. It is su 
that in such a form the problem becomes a sufficiently practica 
though the uursult of it may be by theoretical methods 

In the first place, the percents correct for the standardized 
thev had been obta ned for the three grades of eleven cities 


verted into P. BE. equivalents, and these in turn were reterre 
theoretical zero of spelling ability Since the fourth, fifth, 
vrades were involved, this gave for each word three determ 
its diffieulty, each equally valid but earried out upon data 
vrade. Accordingly, these three determinations were averaged 
.e best determination from the entire data at hand 

The second step was to go through the same procedu 


pereents correct Lor the standardized words as these percents 


obtained from certain fourth-grade classes at City H. Since ty | 
were involved, a separate determination was made for each 
wrder to note how much more re liable the determination from two 
was than the determination trom one school. 

Brief comment will now be offered on the results as the) 
tained for the ten words above mentioned. On the data from 
No. 1 the diffieults ol the word restrain turned out to be 5.56.° W! 
data from School No. 2 were combined with those from the first s ‘ 
the difficulty was found to be 5.88. Now, what we are calling thi 
difficulty of the word restrain—i.e., the difficulty as obtained 
1200 odd eases in eleven school systems—was 5.84. Thus, the diff 
as obtained from the pupils of one school differed from the true 
by 0.28, while the diffieulty as obtained from the two schools ‘ 
differed from the true difficulty by only 0.04, It will elarify our t v 
somewhat if we note, in reference to these differences, that th 
between adjacent columns on the Ayres Spelling Seale is about 0.5 of! 
units here emploved. Accordingly, the discrepancy between the 
of restrain as obtained from the 202 fourth-grade children at City © 
and its true difficulty is only 0.012 of a column on the Ayres Scale. | Wol 


7 All numerical statements of diffic ulty are, unless otherwise stated, in P 
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y close—indeed, much closer than was the case with most 


er Words. 
word high the difficulty trom School No was al from 


hools combined. 5.02. The true difficulty was 4.40 As in the 


trie word restrain we note hi rt the correet ive influence ol! a second 


If the difficulty of the word / igh wert accepted us obtained from 
1 it would be taken as 0.59 units (or two columns on the Ayres 


rder than 1s actually the case When thi second school is added, 


repaney is reduced to 0.27, or about one column on the Ayres 


word purchased ts a hard word, but the vidence of its difficulty 


just aS well by the returns trom the two schools at City Il 


n what we are ealling the true determination. The difficulty 
School 1 is €.12 and from Schools 1 and 2 combined, 7.19 The 
fficulty is 7.12. The diserepancs therefore is only 0.07, which is 

st as small as in the ease of restrain 

three words on which comment has just been made are in a 

way typical of the entire 25 standardized words. From the data 


th schools at City H the average difference tor each word between 


tained determination and the true determination is +0.20, or 
+t less than the amount known on the Ayres Seale as a column. 
means that these fourth-grade children at City H did not perform 
s capably as did the children in general in the eleven school systems 
rhe amount of the difference is not, tor our purpose, the significant 
The only important question is the question of consistency. if 
hildren at City H—or indeed the children of any school system 
od or poor spellers in general rather than with reference to specific 
is then the extent to which their performance on the 25 standardized 
ls differs from the typieal performance will likewise be the extent to 
their performance on the 25 so-called und termined words differs 
that of typical children. If City H represents the standardized 
vords as 0.25 harder than they really are, then it also represents the 


ermined words as 0.25 harder than (they really are. Under these 


nstanees the difference between the record of the fourth-grade chil- 

en of City H and the record of all the cities on the standardized words 

sus a result which we may eall the correction term; and this corree- 

term may be applied to the record at City H on the undetermined 
words to obtain an approximation to their true difficulty. 


Kil 
o} 
A 
‘ 
| 
} 
| 
ce 
at 
| 
7 
UG 


168 JOURNAL OF EDUCATIONAL RESEARCH 


| rr ter . s been shown, is +0.25. The « 
rns the a cation of this correction term to the word 
obtain t “itv H r the 2o undetermined words. Thesi 
culties hen thus corrected 1 then be compared with the 
tor the same \ f ‘ four the 4200 ehil 
ven ‘ wl KNOW ire on eTtenad 
ent I es, that these words are undetermined 
ihe reader will re that 10 of the entire 50 words w 
etermined These ar ! dried, de 
j the 137 iren Schoo] Ni the 
word « ' ind to be 5.59. The diffieulty of this 
202 n | h hools eon ned Was to be 5 
li? S ‘ eted » by oOo ru swe the ert 
{ lren at Citv H has already been fe i (1.e., on the 
\ to by CW the “averavt ] Thre 
just s well—no bette nd no worse in comparison with « 
on thre ist Voras AS thes did on t e first Oh Wwe hi 
thes two dete I tions 99 nad 14 by Too high 
ne tl mount (in other words, using our correction term 
4 for School No. 1, and 5.19 for Schools No. 1 and No, 2 
The ti le adineu 0 contains is 5.55 I] is on this word 
ra n obtained from no more than 137 pupils in a sinele 
, ile school differs from the true standard by 0.22 P 
Hout two ras Ot the interval bet ween TWO SUCCESS 
on the Avres Seal It will be observed that on the word c+ 
returns trom School No l are in somewhat closer agreement 
stand: rd results than ure those ot both schools combined T} 
ceptional 


On the word dried the two determinations from the schools 
when corrected as befor are 6.16 and 6.31, The true d flieu 
lhe diserepaney for School No. 1 is 0.48 which is unusually larg 
a certain extent and reduces the dis 
to 0.50, or to about one column of the Ayres Seal 


The word debts comes out within 0.2 ot the tr 


ie determinat 


S very clos Ihe word anvas, howeve r, 18 ** off by a 


the largest difference obtained in the ease of any word. Lin 


within 0.32 of the true difficulty. Nineteen of the 25 differences bi 
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1 BRIE! 


d values for City H and the true values amount to less than 
lmns on the Avres | None ot the ditferences 
} 
remembe t these 1 © obtained trom o1 
e manner deseribed and those ed from more n four 
s many esses. involving per! twen or twenty-five times 
I Tl eal point not whether we m: he s ' { 
oO} | 1 ¢ Ses Du The 
thus obtai 1 «oes not t to the possibilitv of using 
indardized data to reduce ve eathy the mu rot cuses 
produce results of s In the judgment 
Te thie 1 ned t 4 iS S COMCLUSLE 
the proportion o standare ed element re sed n 
the undetermined elements in a given test the 1 bility with 
indetermined elements m he « lated increases In this 
half the elements were undetermined Instead o fiftv-word 
of 25 words ol known ffi ! 25 yvords ul 
yords ot wht ¢ it ilt hole to 
Inder these ¢ Tis } his Tray Ter Wi nave 
accurate nna dete on of Thre qaimeutt aT 
ned words would have been mor tistactory Or, supposing 
superintendent had only 25 standardized words at his disposal 
ve contented hims: with a test consisting ¢ hese 25 stand 
ords and only 15 undetermined words. His s dardization of 
words would then be more reliable than the result obtained by 
ngement of test mater used in this report \gcain, greater 
might be secured if the number of children involved in the 
as inereased. Instead of 202 children, two or three times that 
light have been emploved if greater precision were thought to 
+ } thy { ‘ le +} lot 
rian Inauy, tor tin puryy. SC Sta undeter 
ds. results might have been secured from two or more graces 
i from a single grade. 
is the question of the possibility of using well standardized ma 
permit the standardization of other material by a short method 
lf to conside rable interest ng experimentation In 


hich lends 
piace, one May vary the proportion of standardized to unde 


al 
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termined elements; m 


eases; and in the thir 


which the test is submittes 


when a half and half te 


it is inferred that this 


iL, 


OF 


second | lac , one 


Wal 
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may vary the 


‘e, one may vary the number ot 


From the results deseribed in 
s used upon 202 children of a 


of experimentation ts promising 


1? 


| 
thi 
ing 
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PROMISE AND PERFORMANCE IN ARITHMETIC DRILL 
SERVICE 
Guy M. WILSON 
Boston University 
[vucH researt h has been done in the last few years on drill in arith 
As a result, new standards and specifications for work in this 
This recognition has been reflected in the 


to textbooks 


ive been recognized. 


ition, prospectus, and advertising material relating 
s field 
ng the past year a sizeable committee in a seminar group under 


analysis of both the pros 


to cheek ct finitely through au complete 
and the materials themselves, the extent 
It is proposed to present herewith a sample 


to which advertising 


ses wert fulfilled. 
iis sort prepared by A. Rebeeca Parsons, teacher at Revere, 
For con 


of tl 


The analysis presented is that of addition. 
“Text Drill Service I 


chusetts. 
this material will be referred to as 


WHAT IS PROMISED IN TEXT DRIILJ. SERVICE I 
ext Drill Service I promises to cover all of the addition combinations 


ver these reasonably in proportion to difficulty as determined by 
the relative difficulty of the number combinations. There are 
UILLSeCS made with reterence to process steps but tor the present 


we shall negleet. The present task, therefore, is to examine how 


Text Drill Service 1 meets the requirement of covering all of the 
portion to 


n combinations and giving them emphasis in proj 


HOW MANY ADDITION COMBINATIONS ? 


\s we are to examine how fully the addition combinations have been 
there are. According to the 
100 and this has been the 


statement in connection with the analysis ot addition drill. Years 
each digit 


|, it is necessary to know how man) 


ives In the text in question, there are 


say that there were 45 combinations, 
45. Courtis taught 


was common to 


added to each other digit, making a total ol 
t the reverses were as important as the direct combinations. Teach 
have taught 4 3. These reverses 


4 does not insure that we 
neglected the zeros. When the 


1 are 45 in number. This, however, 
: are added we get a total of 100. 


But does the above go far enough? Does it take care of column addi- 


Suppose you are adding up a column and have a total number 
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} 


1b ind t he next imbe IS Is the ict b 5? It 
It lt there re assurances it 16 sb 
by t hing 6 » than that 4 ) is taught by teaching 3 } 
} 
me im determi ne he numbe 
n combinations to consider column addition, and at this pe 
ecide } far to go in colum diti 
este n the | of the lies made by others. that extrem 
lm? ere ae he sus ested ittine lor 
mn tw nad definite ! neo tl ‘ ddition re red fe 
] « fix the limit for ¢ imn work at 39 9. we | meet 
ments ti t have een mal ited the t eS SOK 
Ness re rithmeti | ing this as a | t. therefore, | 
i de combinat ms do we nave B ‘rilil wit} 10 We 
4 
; have the possibility of 10 + 0, 1, 2, 3, 4, 5, 6, 7, 8, 9.—a total 
hinations: 111 the same 1” the sam nd so , 
Ww rom 10 +4 nel is e There cle nu il 
bility of 10 additior or each number we t total o 
le ons \poparent therefore } LOO mit 1s 
l ! There are east 300 additior ts needed 
| ng over oul rithmetie work we find that addition ! 
} ow ral but nm mu ( It we take aS a 
wultiplication 9 9 e there any additions ealled for beyond 
> 
There are When we multiply 54 S the first multiplication g . 
ll] the 3. We therefore have use for the decade addition fact 4 : 
; How many such facts are there above 39 + 9 to the limit of 9 } 
q ne ean easily set these out by doing the multiplications and no a, 
carrving DOSSID eS The are a total ot SO as follow 
TABLE 
Tue SO Ap BEY N 
1 4 6, 7 f i 6, 7 
4 6, 7. 8 64 2 
54 4 6, 7, 
16 
‘ If we now add to the 100 primary combinations the 300 de 17 
binations needed for column additions and the 80 higher decacdk 18 
9 
binations needed for carrying in multiplication, we have as the es 2 


. 
‘e 
7), 
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rs the masteru of addit on, a fota ot wi) It appears, there 
t those who constructed the particular Drill Service I, if they 


nite attempt to do it scientifically, started with an obvious 


in not recognizing more than 100 needed facts in addition. It 
possible to show the actual results 


TEXT DRILL SERVICE I ANALYZED 


} 
Parsons has analyzed this drill service so as to show separately 


binations called for in addition alone, those ealled for in multi 


n, and those called for in proving subtraction. It would not be 
the authors of the se rvice to show only the combinations In 
The showing will be a little better, however. if all of the addi 


ealled for not only in addition itself, but also in multipliea 


{in proving subtraction are given. Since this, therefore. is more 


e to the authors of the drill service. it will be done that way 


n it is more favorable to the authors is that oeecasionallv a hole 


lrill service as originally constructed is filled by mere accident of 


iirements in multiplication and subtraction sinee obviously they 


ot cheeked. Tables IT, IIT, and IV which follow herewith she 


TABLE IT 


WITH W ICH TH PRIM ARY COMBINATIO* Occur ix Text Dri Ger or I 
0 1 2 3 4 5 6 7 & r 
18 2 2F 14 if 7 7 

a7 77 7 6 41 44 44 44 40 
7 41 25 23 45 47 11 19 
14 35 33 25 44 ; 4 19 14 17 
e 17 4 25 Qf 2 17 18 
23 i4 $2 42 24 19 2 16 
19 22 32 17 18 f 42 4 p 
f ) 32 23 4 19 23 
7 49 2 21 27 24 29 37 3° 6 
TABLE III 
WITH WHICH THE Upper DECADE COMBINATIOD OCCUR IN 
Srrvice I 
0 1 2 3 5 6 7 - r 
11 37 28 25 2 
11 ® 17 ! 2 
6 27 22 20 24 12 Q 9 35 a 
9 6 11 15 12 21 7 
5 15 13 3 4 11 1 
§ 14 17 17 13 3 1 f 11 
7 8 4 22 l 14 7 
4 14 l 15 12 f 14 12 & 
3 13 a 7 9 23 
; 22 19 18 21 25 29 21 2 26 
5 4 3 7 7 ~ 2 3 13 


+}, 
fa 
‘ 
} 
lp 
| 
+ 
> 
sg 
‘ 
5 
> 
> 
> 
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= 


FRE QUEN( 


ARRYING IN 


0 


TIFICATIO 


1 


WHICH 


re 


THE 


TABLE III 


WHICH 


oof 


waerc 


Aron 


TABLE IV 


THE 


ARRYING IN 


TEXT 


T 


MULTIPLICA 


R OCCURRENCE, 


2 


DRILL 


DECADE 


( 


Continued 


we 


wen 


‘OMBINATIONS 


MULTIPLICATION OCCUR IN 
iT 


TABLE V 


IN AND 


3 


OCCUR 
4 


SERVICE 


IMBINATIONS 


THEREFORE 


IN 


TEXT 
5 


BEY 


a 


HAVIN 
DRIL! 


6 


24 2 4 
25 1 5 
26 1 1 7 
27 2 12 
28 6 y 
39 1 4 4 
30 7 i 12 
31 1 2 1 64 
35 3 2 3 ag 
37 1 2 1 
38 2 2 3 
39 1 1 1 
74 
9-9 po. Cre 78 
1 2 4 5 7 a 
A 
! } 40 3 4 6 5 2 3 we 
42 2 5 3 4 6 
45 1 3 1 2 2 2 
48 2 1 1 4 4 1 a4 
b 49 1 2 2 2 1 86 
J 54 2 4 1 1 1 8 
56 2 1 3 3 1 
63 2 4 1 1 88 
64 2 1 1 
ia 72 1 2 2 ° 
81 1 2 
A 
| 40 
a 41 
43 1 2 
44 1 1 ! 
45 
46 1 l 
47 1 2 2 
48 2 1 
49 1 3 
50 
61 1 
52 1 2 1 
re 55 
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TABLE V—Continued 


5A 1 1 
1 
1 1 1 
1 1 
) 1 
1 1 
1 
1 
AT 1 1 1 1 
1 1 1 
, 1 1 1 1 
7 1 
72 1 
oe 1 1 
7 1 1 
on 1 
7 1 
1 
? 1 1 1 1 1 
81 
1 
1 1 
a4 1 1 1 
1 1 1 
a6 1 1 1 
1 
RR 1 1 1 
1 1 
92 1 
4 1 
1 
6 1 


TABLE VI 


~ ING SUMMARY OF COMBINATIONS TAUGHT AND (C'OMBINATIONS I'SED IN 
rext Service I 
Facts TAUGHT Facts Usep 
act 94 Primary facts 100 
fact to 39 +9 = Decade facts to 39 + 9 276 
arrying in multiplication be Facts for carrying in multiplication be 
0 yond 39 + 9 62 
Tots 102 Total ; 438 
102 
Part t tanght used in examples 336 
4. 


° either taught nor used 


; 
4 
8 
‘2 
= 
ay 
97 
oa 
ih 
2. 
pe 


needed in mu 

ing the prol 

had not the 
or 


The 


taught 
have 
m 
ft 
wer 
used, al 
taucht 


above 
more-o 
the 
le for 
he « 

TI 


of oceurrenes 


determining the 


which | 
It is 


cult, tota 


whi 


JOURNAL OF 


+h, 
ond 
} 


‘ } 
} 
TY 
tit 
i 


FDUCATION RESEARCH 


Di iry or first decade combinations; the 
1 for column addition to 39 9. and the « 
eded for earrving in multipheati 
de com nations b yond 9 wh 
tion. This table 1s in teresting 
that the author who constructed the 
rrived 1 very fundamental mastery 
requirements 
FINDINGS ANALYZED 
V tell the ston ilvsis 
! vhout the pages of text ar 
| t 1 ! ere Ot 
lril evident not 
MISTI ted | 1 ( 
thre troduetion. prospectus the 
dye Sitiyy ciel riment at 
SO] tselt The « 
es mar Table VI 
s indieate that of the total of 480 fact 


tematica 


102 


180 faets used im the drill 


ORDER 


facets of 


introduction claims, has been used as 


suency of combinations. 


llows herewith 


urrence, while 


interesting to note that 


$97 


‘onsciously taught. That ts, 1 


llv. This means that an effort 


iets The othe r 378 


facts of th 


ill service, 


of the 480 facts were neither ta 


erviee, 


OF DIFFICULTY 


» are available on the Text Dri 


| will be given, viz 


, a comparison of the 


he drill service with Clapp’s 0 


a 


This is shown in 


the first column of facts, the m 


the column of least difficult 


ia 


Ti 


respectively, Opera 
combination cade 

Table V 
\ he 6-8 
id 
fables If, 111 3.9 
Drill Ser ‘ 
tha r rel 
ther shown from 
|| tab 102 
ls _ the t 
them. 
: 1 in the construction of the dr, 4s hf 
While eons other |) =: th 
I, only one othe 
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TABLE VII 


COMBINATIONS IN TEXT DrILt SERVICE I CoMPARED WITH CLAPP’ 
D CENDING OrpDER OF DIFFICULTY 


Q-2 FREQUEN( FRE EN( Q-4 FREQUEN 

Q. 2 7.) sa 

9-3 7 2 24 

3-8 10 8-1 4-1 

i | 18 21 

14 4 14 

17 3 f 4° 1-8 28 
24 18 4 
7 24 ( 2 10 

18 14 4 4 19 
i-s8 f 3-3 3 

ia 9 1-1] 69 
1 17 ) 11 

»- 2 21 6-4 a-8 48 

4 4 20 1 i a 1-3 37 

a 1-2 47 | 42 1-6 25 

l 1f 1 >3 

! »- 3 1 6-6 i 2-1 3 

1* 2 52 

11 18 49 

49 467 ’ 
irrenece. This distribution of facts may be justified on the basis 


ng requirements, but it hardly squares with the claims of the 
hat the combinations in the drill service are measurably ad 


n trequeney to the requirements ol Clapp’s tudy on Order 


PURPOSE OF THIS REPORT 

purpose of this report is not to condemn a particular drill ser 
It is to eall attention to the fact that drill services can be con- 
according to definite requirements and should be so constructed ; 

ier fact that it Is, to Sa) the least, unethical to make claims 
re not supported by the facts. It doubtless could be added with 
that for the most part writers of text books and constructors of 
rvices have done it without having in mind any very definite 
ments, have not checked the ir services, and do not know, when 

very much if anything as to what the drill serviee contains 
be suggested also that the time has arrived when superintend 


schools and those who select texts have a right to ask for the 


hy 
Q REQ 
“3 
a.Q 
‘ 
re 5 
ed 
T 
+} 
l 
t ma 
so 
4 
re 
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definite specifications with reference to what a book contains. [1 
ing the 186 pages In which the process of addition is taught ' 
get an idea this particular addition drill service, Miss Par 

a total of about 200 hours Is it too much to ask of an aut 


do this task before publishing his books? 
The tables given in this st vd suggest a plan for checku 
more adequate than has be« n common 


mits one other essential 0 


f th drill ovel the process steps 


check, viz., the distributin i f 
4 
of 
g 
‘ 
’ 
’ 


4N ANALYSIS OF THE NATURE AND FREQUENCY OF 
SUPREME COURT CASES IN SCHOOL LAW FOR 
THE CALENDAR YEAR OF 1927 


Ricuarp B. THIEL 
Lau rence College 


Lyon of the Supreme Court of Wisconsin in writing the opin 
} 


the court in a well known and much quoted decision, made the 
ng statement: ‘‘Our system of public schools necessarily involves 


st delicate relations between parents and ehildren on 


the one 
d the school authorities on the other, and controversies most 
ntlvy arise growing out of the enforcement of school discipline. 
mtroversies, relating as they usually do to the control, manage 


1 correction of pupils, are apt to have their origin in wounded 


tal feelings. and are frequently prosecuted with much bitterness 
e 
s cause for congratulation that so few of these controversies appear 
e courts.’ 


While the above quotation is true enough in a way it seems to imply 
t the major number of controversies pertaining to school matters that 

the state eourts of final resort arises out of such disciplinary 
tters. This may or may not be true. In order to determine the exact 


re of these controversies a study was made of all Supreme Court 
ses involving points ot publie school law re ported for the ealendar 
f 1927. A more exact statement of the problem of this paper is 

g below. 
Nfatement of Probl nie ] For the eal ! dar ve ar of 1927 wl at was 


yroximate number of cases in public school law passed upon by 


supreme courts of the forty-eight states in the union? (2) Are there 
sectional differences in the frequency with which these eases oceur? 
Is there anv relationship between the number ( f such eases and 


tion, or geographical area? 4) What is the precise nature of 

ses passed upon? 5) What are the most likely reasons for sec 

variation in the frequency with which eases oecur? 

Collection of Data: This study is based upon the cases in school law 
ted by the National Reporter Svstem.*. The number of cases given 
rly complete and the accuracy of the reports is considered highly 
State er rel Burpee v. Burton 45 Wis., 150: 30 Am Rep 706. 

* National Reporter System Sectional Reports. St. Paul, Minnesota: West Pub 
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liable, wv is reflected by the fact that they are accepted 
I na irts throughout the nation The cases were tal 
en tates mad and second. according 

te } ved | e seLlteeTion OT cCaseS Was 
the « ne vear of 1927 The number is deemed sufficient! 
te prese eS 


ae West Virginia 


From Table I it is seen that seven states have reported 
w: Connecticut, Maine, Maryland, Mass 
Nevada, Rhode Island, and Utah. All of these, except two, 
‘ ‘ part of the United States. Seven states report ten or 
namely Arkansas, California, Kentucky, Missouri, Oklahom: 
and Georg of which are ecomparativel) rsely populated 


the eparsit f nopulation is associated with the number of cou 


3 al S vn by comparing the sections east and west of the Mis 
River. The nineteen states west of the river reporting supren 
eases show total of 129 enses. or 55.8 pereent of the total, whe 
th . nike up only 27.8 pereent of the nation’s population 

Table IT shows the number of eases by sections aecordit 
Nati IR ter Svstem. This division, although somewhat 


mad follo geographical lines Here it is again evident 


Pacifie and Southwestern states show the largest number of 


l 
TABLE I 
4 ( CA INVOL\ Q ION I 
| STATES OF THE UNION FOR 
: 1g CALENDAR YEAR 1927 
4 N raska 
rf N 
‘ New Hampshire 
‘ l New rsev 
New Y 
North Dakota 
" 14 Ohio 
Oklahoma 
4 
Pennsylvania 
R} I a i 
th Caro a 4 
] s th Dakota y 
7 Tennesse 
ag ) Texa 
ue 0 Utah 
Vermont 
Virginia 
acit 
iy, 
lexas 
Te ff) 
2 | 
iT 
that t 
ever) 
court 


TABLE II 


SUPREME CA IN\ S 
I 1927, ¢ 1S 
APPROXIMATE A 4 AND | Ea 
N F REA 
1 ‘ 
M M N_H N Pa 
Mass N.Y OF 14 4 
Minr Neb D D 
a. Mi 
S. Car Va W a 
M re Tex 4 4 i 
Ida, Ka M N. 
Utah, Was! 9 
a4 
rABLE 
Per CASE AND AREA IN SQUARE MILES Per CASE FoR CASES IN SCH 
LAW EACH SECTI if y 
N oF I I \ N = AR 
CASES CASE MILES PER Cas) 
1,31 
14 2,101 
4 7 
20 $45.2 1 4 
29 é 
66 9 ) 7.14 
59 21 < 
Arithmetic mean 4 


In Table IIT the ratio of the population to the number of case: 
licated for the United States asa whole. There is one supreme court 
school law to about 455.700 inhabitants. The states in the North 
tern section seem to conform to this average while the states of the 
ntie and Northeastern sections vield a ratio more than three times 
rable and the western states show a ratio of one ease to about 
218,000 inhabitants which is more than double that of the mean for the 
is a whole. 
making comparisons between the number of cases and the area 
e miles, the mean for the nation was found to be one ease for 
12,900 square miles. The correlation (Pearson’s formula), be 
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tween the number of cases and the area in square miles comp 


states was found to be low, only .23, with a probable error of + .09 


therefore not significant 
yrecise nature of the issues in the 2 


In order to determine ie 


yurts the classification of American Re; 


cases passed ipon the « 
Key System was used. The Law of Public Schools according to this 


system, is eonsidered under 170 items, or points of law. each 
which is given a number. Whenever this number is indicated it 
to that particular point of law, for instance, Key No. 18 always refers 
to Apportionment of School Funds. No. 20 to Nature and St 
School Districts as Corporations, and so on. These 170 items are g 
into eight divisions as indicated in Table IV. 

In elassifving the various decisions in Table IV the grouping 


made not merely aceording to the 


number of cases but according t 
number of points of school law involved. As some cases involv: 
one to five distinct points of law, the totals will not correspond t 
of Tables I to III. 

TABLE IV 


Points oF Law PAssep UPON IN 251 8 
ry-Flicgut STATES OF THE UNION DURING THE 


rHE For 
CALENDAR YEAR OF 1927 
E.stablisl t t fu ar egula enera 
B Creat at t t and f t 
hist t pre ty act 4 abilit 
t let st taXxat 
I Cla against distr a rz li 
Tea r 
H Pupil conduct and discipline of schools 30 
Tota 


A glance at Table IV reveals that the first three divisions relate 
territorial and administrative organization of districts and their g 
ment. This accounts for 159 of the 398 points of school law tal 
or 40 percent of the total. Most of these cases may be traced to te 
sparsely settled regions in which the changes in population « 
creating or altering districts, and providing for their administ: 
Arkansas. California, Georgia, Iowa, Louisiana, Montana, Ok! 
Oregon, Wyoming, and Texas contribute 
the total of the 159 points, Texas leading the list with 14. 


78, or practically 50 pere 
Controversial matters affecting school property, contracts, 
debt. claims and taxation, that is, cases affecting the taxpayers’ 
books, compose 171 of the 398 points, or 43 percent. An inspect 
the tabulations reveals that these cases are not confined to any sec’ 
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r rather more frequently in the newer sections, as changes in the 


es of districts require a readjustment of financial matters, and 


tricts call for new buildings. It is interesting to note that in this 


‘3 points of law arose out of contractual liabilities, 34 out of 


ties in issuing school bonds and warrants and 54 dealt with 
es arising out of tax levies. 
With regard to the difficulties referred to by Judge Lyon in the 


ns of teachers to pupils and parents, the number of points of 


iS only 6S, or 17 percent Of the 38 dispute s affecting teachers, 
dealt with certification, twelve with matters relating to appoint 
nd contract stipulations, fifteen with suspension, or dismissal, in 
y actions for damages, and the remainder with pensions and 
atters 

Among the 30 cases affecting pupil conduct and discipline, seven 
to the payment of tuition, seven arose out of claims for trans 
tion, two in regard to vaccination, two to compulsory attendance, 
it the number that pertained to ‘‘those delicate relations between 
nts and children on the one hand and the school authorities on the 
was almost negligible. In fact there was only one ease that grew 
of punishment by expulsion. It is indeed remarkable that in the 
ttendance of more than 20,000,000 pupils for the entire year of 
‘7 there were so few serious legal controversies in matters of discipline 
ol management. What other branch of our publie service can 

to a record comparable to this? 
s study shows with similar decisiveness that the great storm center 
lueational litigation is the administration of the school’s finances. 
umber of statutes regulating these matters is common knowledge 
iirectness and clearness of the wording of these laws is known to 
school administrators, hence it is evident that the management of the 
listriet’s finances is loose, though not necessarily dishonest. Much of 
Ss 18 due to our highly decentralized S\ stem of school government. 
s equally apparent that the greatest prevention lies in the direction 
re capable supervision of school finances by educational admin 
strators and financial experts. The successful school superintendent, 
nr than ever, must be conversant with principles of modern business 
nistration and well informed on legal matters pertaining to his 


professional relationship. 
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SUMMARY AND CONCLUSION 


1. The total number of Supreme Court cases passed upon in 192 
relating to matters of school law was 231, in which 398 distinet | 
of school law were involved 

2 There is evidence of a greater frequency of cases in school 
the western and southern states, probably due to a great extent 
sparse settlement and shifting population 

3 The ratio of the number of State Supreme Court cases t 
population for the nation is 1 to 455,700; in the eastern states it is 
about 1 to 2,000,000 and in the western states, 1 to 218,000 

4. The ratio of the number of Supreme Court cases to area in squ 
miles is 1 to 12,900. The coefficient of correlation, (Pearson formu 
computed by states between these two factors 1s 23, with P.E. + | 
and therefore not significant. 

5. Of the total number of 398 points of school law passed uJ 
159, or 40 percent pertained to the territorial organization and 
istration of school districts. These cases were largely confined t 
more extensive and sparsely settled states of the South and West 

6. Forty-three percent of the total number of points of law w: 
eerned with matters of fiscal administration, such as (a) Sale and 
agement of school property, (b) Contracts for buildings, equipment 
supplies, (¢) School bonds and warrants, (d) Matters dealing wit 
levy and collection of taxes. 


7. The controversies affecting teachers and pupils, including cor 
and discipline, were comparatively small in number, about 13 percent 
the total. Most of these grew out of disputes coneerning the 
ment and dismissal of teachers, the payment of tuition, or matters 
taining to pupil transportation; so that the number of cases growing 
of disciplinary matters was negligible. 

8 The large number of eases growing out of the formation and g 
ernment of school districts and their fiseal administration suggests 
need of further research in matters of educational organizatior 


control, and greater efficiency in fiscal administration. 
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, COMPARISON OF THE TIME SPENT BY FIRST-YEAR 
STUDENTS AND EXPECTED BY TEACHERS IN 
A STATE NORMAL SCHOOL 


N. A. WADE 
Frostburg, Maryland, State Normal School 


[His study was attempted for the purpose of answering the follow 


juestions pertaining to the junior or first-vear class of the Maryland 


te Normal School: How does the average weekly time spent in study 


re with the average weekly time that teachers expect? Is the time 


| to study for a recitation in each subject greater or less than each 


expects? On how many days does the average student study 


w is it distributed among those days? What is the average 


time spent in study, recitation, extra-curricular activities, and 


combined ? 


facts pertaining to students were collected by means of a time 


sheet! kept for 6 weeks during the winter term of the school ye 


the purpose of the time-record sheets and the mimeographed 


ar, 


928. The writer visited each of the three class sections and ex- 


di- 


The records of 80 students os girls and 12 bovs Section IT) 
“7 percent of the class of 92, were used To Save spac only the 


e sixth week, ineluding the horizont: 


! column for the totals 


6 weeks, is reproduced with the directions. The headings varied 


to the subjects pursued by each class section 


accuracy of the data furnished by the students depends, 


of 


on the care and honesty exercised in keeping the time-record 


[s To encourage truthfulness and acceuraey the students were 


sed that no instructor would be al mitted to see any of the 


l after he had made his term reports and, furthermore, if they 


1 


d, that they need not return their time-record sheets until they 


ved their grades. 


W 


hout the knowledge of the students, each of the faculty members 


teaching the junior classes was given a sheet with a column 


by his subjeets and sections, subdivided into three columns 


m, average, and maximum—and lined to provide for all the 
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vents for the six weeks for which students were keeping time- 


from the form prepared by Gray, W. S. ‘‘Standardization of Stu 
‘ourses.’’ Educational Administration and Superviston. VII (1921), 


sembly 
- 
terre 
M fied 
ny 
121-132 ~ 
> 3 
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TIME RECORD SHEET 
Geog Hist. | LA Mus Pt R.P 
Date Deyes |P | 
Te | 
a Total for the 6 Hrs = se 
P —~ Preparation I ides anything done in preparation for recitation in ea 
hk —- Recitatior Includes time for taking tests during class 
A.-Industrial Arts 
P.E Physical Educatior 
R. P Reading Process ae 
1. Each time you work on any subject note the time in minutes. Two « 
a) Keep your record accurate and neat. (b) Be sure to include every 
oe activity which is a part of the preparation in each subject, and the time s 
recitation in each subject. 
2. Record the date in the left hand column of the table and insert the number 
of minutes in the appropriate blank or blanks. 
3. At the end of each day add together the number of minutes which a 
the record for that date and express the sum in the right hand column of 
in terms of hours and minutes. 
4. At the end of each week add together the number of minutes whi 
in the record for that date and express the sum in terms of minutes in the | 
column of totals for that week. 
5. At the end of six weeks add together the number of minutes which appear 
a the various totals in each column. Record the sum in terms of hours and 1 
“ed in the appropriate blanks at the foot of the table. 
9 record sheets. On these sheets the instructors were asked to observe the ra 
wee following directions: 
in ‘*Before making each assignment in each of the following courses 
will you estimate in minutes the time—minimum, maximun 
average—that it will require the students to prepare it? Students 
should not know that this is being kept. Students should not be as 
to give the time they spend in preparing each assignment.’’ 
An examination of Table I shows that the average weekly time 
4 voted to study by Sections I and III is approximately 2 and 5°, hous @. 
less, respectively, than the average according to the estimate 
teachers; that Section II spends about one hour more per week on t! iia 
ct 
ey 
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TABLE I 
ARISON OF THE AVERAGE WEEKLY TIME SPENT IN STUDY BY SO FrrRst-YEaRg 
NoRMAL SCHOOL STUDENTS, ACCORDING TO CLASS SECTIONS, WITH THE 
AVERAGE WEEKLY TIME EXPECTED BY THE TEACHERS 
(Time expressed in hours and minutes) 


AVERAGE WEEKLY TIME FoR StTwpy 


SECTION No. OF CASES STUDENTS HERS 
I ig 21.53 23.51 
II 31 21.34 20 36 
Ill 30 20.18 26.00 
Class average total) 80 21.35 23.29 


ge than the teachers’ estimate; and that, according to the weekly 


erage for the elass, the students devote to study 2 hours and 14 min- 


ess than the teachers expect. It should be noted that Section III, 


est group according to the Otis Self Administering Tests of Mental 
\bility, reports the least time in study of the three sections while the 
“@ teachers expect the most time. 

Since the students of each section have 20 recitations per week, the 

ge time devoted to preparation per recitation is 66, 64, and 61 

ites for Sections I, II, and III, respectively. Thus the average prep- 

for a recitation is one hour and four minutes. 
TABLE II 
AVERAGE NUMBER OF MINUTES SPENT BY EACH JUNIOR SECTION IN PREPARATION 
FOR A RECITATION IN Eacu SUBJECT WITH EACH TEACHER’S 
ESTIMATE FOR THE AVERAGE TIM} 

Arith Geog Hist Eng. ! Music P. 1A? Pen &P 


S.A.T.A. S.A.T.A. S.A.T.A. S.A.T.A. S.A.T.A. S.A.T.A. S.A.T.A. S.A.T.A. S.A.T.A.S.A.T.A SATA 
67 60 83 90 & 120 95 90 42 60 27 33 58 95 39 15 

70 60 104 105 85 72 38 45 23 30 73 8 4515 52 30 
72 70 57 100 78 100 


f ra asses 70 63 70 95 81 110 99 97 75 90 81 8! S875 23 3 65 90 42 15 52 W 


8 Includes required outside reading 
2? Includes time devoted to preparing projects 
S. A.—Students’ Average 
r. A.— Teacher's Average 
R. P.— Reading Process 
E.—Early Childhood Education 
P. E.— Physical Education 
I. A—HIndustrial Arts 
Pen.— Penmanship 
0. and P.—Observation and Participation 


Is the average preparation for a recitation in each subject one hour? 
Does each teacher expect the same average preparation? Both ques- 
tions are answered by the facts presented in Table II, which contains 
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the subjects pursued by each section, the average time that students 

spend in preparation for a recitation in each subject, and each teacher's 
estimate of the average time necessary for preparation for a re 2 
in each subject. Possibly the most important thing that Table II reveals 

is the wide variation among the different subjects and sections 

the averages of the students and the teachers. This is tru g 

both the full-credit subjects—arithmetic, geography, history, Eng 

reading process and early childhood education and the half-ere lit 
subjects—music, industrial arts, physical education, penmanship, and 
observation and participation. The range for the students’ average in 

the full-eredit group is 57 minutes in Section III Geography to 104 
minutes in Section II English; for the teachers from one hour in § 

tions I and II Arithmetic to two hours in Section I History. For t 
half-credit subjects the range of the students’ average is from 19 mir 

utes in Section III Physical Education to 73 minutes in Seetion III 4s 
Industrial Arts; for the teachers’ estimate from 15 minutes in Sections 

I and II Penmanship to 95 minutes in Section I Industrial Arts. It 
should be noted that in industrial arts, a half-credit subject, the teacher 
expects more time than the instructors in some of the full-credit subjects gs 
and in the case of arithmetic receives more. A further study of Tabl 14 


II shows that the students in general spend less average time in 
for a recitation in each subject than the teachers estimate. 

The typical student not only distributes his study time unequally 
among the different subjects, but also spreads it unequally among the 
different days of the five-day week. Moreover, he spreads his st 
time for the school week over the entire 7 days. He has four recitat 
per day; but a study of the third week shows that the median time for 
preparation ranges from 2 hours and 3 minutes on Friday to 3 hour 
and 55 minutes on Thursday; that slightly less than one-half of 
students study on Saturday; and that the majority reports stud) 
Sunday, the median being 2 hours and 3 minutes, approximately the 
Same as Friday. 


If to 21 hours and 15 minutes, the average weekly time devoted 


study, 18 hours and 12 minutes for recitation, 2 hours for extra 


curricular activities,? and 1 hour and 50 minutes for assembly per week 
are added, the typical student of the junior class devotes 43 hours 

17 minutes to four types of school activities. This is 43 minutes less 
than a standard business week of 44 hours. 


* Determined by a separate study. 
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SUMMARY 

1. The average first-year student of the Maryland State Normal 
. | spends 21 hours and 15 minutes per week in study, while, ac- 
ng to the average estimate of the teachers, he should spel d 2 hours 

14 minutes more, or 23 hours and 29 minutes per week. 
® Based upon the average time per week spent in study, slightly 
e than one hour is the average preparation for a recitation. But, as 
itter of fact, the average preparation varies greatly among all sub- 
Hoth full eredit and half eredit subjects Wide variations char 
the average preparation that the teachers expect in the different 


subjects, regardless of credit allowed, and in subjects carrying the 


The typical junior student seatters his study time unequally over 

seven-day week, studying least on Saturday and as much on Sunday 
as on Friday. 

}. Most teachers expect more time for the average preparation than 
receive, 

5. For 4 types of activities—study, recitation, extra-curricular and 


ssembly—the weekly average is 48 minutes less than for a typical 


44-hour business week. 


RESULTS 


The daily sehedule has been increased one period per day in 
to secure a longer work day at school. 
2. The faculty is attempting to arrive at an understanding of what 


nstitute a reasonable work week in terms of time. to agree 


a more uniform time requirement for subjects giving the same 
lit toward graduation, and to formulate methods of seeuring econ- 
adequate preparation for each reeitation in each subject. 
During Junior Week good work habits for teachers, how to study, 
effective use of time were stressed more than ever before. Fur- 
, the emphasis upon these factors has been continued. 
t \ plan is being evolved to extend extra-curricular activities to 
lv and to prevent over-emphasis upon the part of some 


Students have become interested in budgetin g their time and in 


g the time required for assignments. some students having volun 
asked for time-record sheets. 
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CRITERIA FOR JUDGING THOUGHT CONTENT IN 
WRITTEN ENGLISH' 
ZELMA LANGDON HUXTABLI 
Edison Junior High, Los Angeles 

By what criteria may the thought content of written Englis} 
judged? This is a question which confronts and puzzles every 
of English as well as every teacher of any other subject which ¢ 
subjective written opinion. 
af Without question, the thought content of written English sho 
termine a large share of its relative merit. Yet in many courses ¢ 
the teaching of grammar, mechanics of punctuation, and spelling 
phasized almost to the complete neglect of the thoughts to be ex; 

The goal, in other words, has been lost sight of in a near-sighte 
to smooth the was toward it. 

During a recent survey of the composition abilities of mor 
29,000 children in the Junior High Schools of Los Angeles, an effort 
og made to evaluate statistically the status of grammar, mechanics o/ 
ar position, spelling, and thought content. In fact, the particular object 
=. of this work was to discover any evidence which might indicate a 
: frequency of certain types of errors at particular IQ levels with a view 
i to the construction of a differentiated course of study for slow, averag 
and fast learning groups. Miss Mabel Hermans, supervisor of E 
instruction in the Junior High Schools, has already made usi 
of the facts disclosed in this survey in her course of study 
3 PROCEDURE 

In order that the reader may understand the procedure wi! 
described in the paragraphs following, the test instructions given 
English teachers in the Junior High Schools of Los Angeles 
plained in full. Each pupil was asked to suppose himself writing 
friend who had previously attended the same school with himself 
first, about some interesting event which had recently taken | 
school; second, about something which would especially interest 
friend to whom he was writing, and; third, about his own plans 


summer. 

eel: *The details of procedure in this problem were worked out under the 

sh of Dr. A. S. Raubenheimer, of the University of Southern California. The writer 's be 

neg also indebted to Miss Mabel Hermans, Supervisor of English instruction in t Los 

x Angeles Junior High Schools, for permission to use composition papers writt 
her direction as well as for much personal inspiration and constructive critics ate 
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\iIthough the composition contents were, to this extent, dictated, the 
vere quite within the experience of every child and, consequently, 
ircely offer any impediment to individual habitual modes of writ 
ression. Furthermore, as the assignment was given in the form 
est of which the children had knowledge, its product offers excellent 
lora study of this kind where quality and native ability are the 
es under serutiny. Before the test compositions were sent to the 
xy Department, each teacher was requested to read the papers 
by her pupils, mark errors with colored checks, and attach to each 

the IQ of its writer. 
Inasmuch as a minute examination of more than 29,000 compositions 
ext to impossible, 1200 papers were finally selected indiscriminately 
ls attending schools in all localities of the city, except for grade 
I). In other words, 200 papers were taken for each of the six half 
es, B7, A7, BS, AS, BS and AQ: of these, 200 for each half grade. 


pers were chosen from the following IQ groups: 


IQ 
89 (and below) 90-110 111-129 1a¢ and above 
50 50 50 n 
50 50 0 
0 50 50 ) 
78) 
50 
50 50 


lhese 1200 papers were then read and evaluated for mechanies, gram 
spelling, and thought content by four graduate students in eduea- 
who were also experienced teachers. 
\s might be expected, tabulation of the frequency of errors in 
hanies, grammar, and spelling correlated positively, and, on the aver- 
ge, consistently, with the four IQ levels. The evaluation of thought 
ntent, however, presented quite a different problem; one, in fact, which 
s solved with doubtful success by any of the best known composition 
[hat some positive correlation existed between the complexity of the 
ight expressed and the IQ was immediately apparent to all who 
ndled the compositions from the beginning of the study. But, in spite 
he undeniable fact, the task of drawing the line between lower and 
gher levels of thought content was by no means an easy one. Neces- 
sarily antecedent to an attempt to judge thought content with an IQ 
standard of achievement, one must have at one’s disposal first-hand 
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criteria from many examples of performance at each intelligences 
Hence. the following procedure was outlined and followed 
Six hundred of the twelve hundred papers were read with 1Q’s 
and descriptive criteria were constructed purporting to class 
of thought expression to each of the four IQ levels These 
comprehended five levels of thought complexity which were defi 
[. Inarticulate Thoughts 
Il. Unrelated Thoughts (On Sense Perception Level) 
I1f. Related Thoughts (On Sense Perception Level ) 
IV. Reflective Thoughts 
V (‘reative Thoughts 
; Upon each general level of thought expression were found, in « 
; stance, slight differences in excellence due to the absence or pri 
of errors in grammar, mechanies, or spelling. These differences 
i noted by the types appearing at each level. 
As a second step in procedure, the remaining six hundre 
twelve hundred papers were read and classified by the *‘ criteria 
E> out knowledge of the 1Q’s of the writers in order to find out whet 
first ‘‘eriteria’’ had been unduly influenced by the fact that t ( 
a were know) No changes were made, however. as a result of 
: In other words, the ‘‘eriteria’’ were just as valid when us¢e 
knowledge of the [Q’s as they were when the information was ; 
This second step was checked by a study of the [Q’s after the } 
been classified by the ‘‘eriteria.”’ 
: Finally, as a conclusive check, fifty compositions chosen fro1 
levels of the AS grade were read and elassified for thought content S 
group of fifty teachers. These papers were so arranged that « 
was read and judged by five different teachers. In all, two hu 
Ps fifty judgem nts (50 times 5 were obtained. The IQ's on these 
3 were unknown, and thé ‘‘criteria’’ ineluded in this report were usi 
fewer than five minutes had been spent in explanation of their | 
and application. 
PE Sinee the significance of the ‘‘eriteria’’ depends in large part 
= their utility to the layman, the remaining paragraphs are devote | 
. various features of the conclusive phase of the experiment. | 
3 OBSERVATIONAL CORRELATION BETWEEN IQ LEVELS AND LEVELS 
pi OF THOUGHT EXPRESSION 
: Before the presentation of the actual correlation between the t 
judgments based upon the ‘‘eriteria’’ and the 1Q levels. a few word 
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me interesting features of the observational correlation between 
evels of thought content which became the bases of the ‘‘erit- 
[he unquestionable general correlation between IQ levels and 
thought expressed has already been commented upon. Ex 

there were, of course. Indeed, if one’s IQ were always revealed 
tten thought, English teachers might be relieved of much of 
isibility now charged to them. In reality, on the other hand, 
ve need for improvement in written English, especially with 
thought content, was emphatically noticeable even among the 
ht. Frequently pupils with 1Q’s of 140 and above fel! to aver- 
even low levels of accomplishment judged by the complexity of 
ont « «pressed In view of the marked decrease of mechanieal., 
eal, and spelling errors among the very bright children as com 
th the low and average groups, one must conclude that thought 
composition has not been the principal concern of English 

\ rare individual is he who uses the fine shades of grammar 
chanies of punctuation to the end of greater, de« per, and mors 
defined thoughts. In spite of much overlapping, as indicated by 
teria,’’ there were no papers marked with IQ’s average, bright, 
bright, which fell to the level of ‘‘Inarticulate Thoughts’’ (See 

e, p. 192) ; and, conversely, there were none marked with IQ’s 89 
which reached a level higher than ‘‘Related Thoughts on a 
ptual Level’’ (See Example, p. 193). It is impossible, apparently, 
ndividual whose I) is low, 89 or below. to think reflectively 
the world and its relationships with himself ar perceptual. 
stated, his response is governed largely by the stimulus and 

he interaction of the stimulus percept upon a free concept. Al 
riably the papers from low groups contained gross situations 
analysis of details, and almost as consistently these situations 
enumerated, failing of both immediate and remote coherence: 

om average groups tended, also, to reveal a perceptual under 

z of environment, but an understanding unmistakably evidenced 
ch consistent relatedness of details. The tende ney to unify thought 

nereasingly consistent with the higher 1Q levels. 

mples of compositions agreed upon exactly by four out of five 
s to belong definitely to certain specifie levels of the ‘‘eriteria’’ 
\ correlation of 63 was obtained from the 250 judgments given 
0) teachers previously mentioned, and the IQ's distributed in 
soften. In fact, a few experienced judges discovered that they 
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eould el; the of a Junto high-school pupil correctly W 
general placement as low, average, or high, about four out of 

fter reading a paragraph or two from his social lette1 \ 
judged accordingly, as belonging to ‘‘Level II, Type I’ mig 


scribed as containing 


mar, punctuation, or spelling 

} 

He or ! ") e oor ¢ I ov vernat 
| 1s is too frequently the cas bright child, or even au aver 
To this |e 0 th rhit he ild irnish Si] 
em oO ( consideration on thre pr rt of thre teacher 

The examples which follow illustrating each thought lev 
those levels. are 1 procdueed verbatim un to Li vel 


From this point on through Level V, the examples quoted ar¢ 


In other words, there were no compositions which reached Level I\ 


n recessive level and type. This may be laid in part te 
mmaturity of junior hieh-sehool pupils and in part to th 
eachers to emphasize the importance of thought in written I 


CRITERIA FOR JUDGING LEVELS OCF THOUGHT CONTENT IN 
WRITTEN ENGLISH 
Level I. INARTICULATE THOUGHTS 
WORDS PAILING TO CONVEY THOUGHT BECAUSI 
USAGE OR MISSPELLING 


} 1Q 78, Penmar ship 20 by Gettysburg Seal 
The Taclaly played the Ser Friday the fact 
with a big seni 
During my sumr tion Im going to Sandiag 
I’m study. for Radio engen 


Tupe 2. GROUPS OF WORDS FAILING TO CONVEY. TIE 
CAUSE OF FAULTY MECHANICS OR GRAMMAR, IN 
THINKING, OR MISSPHRLLING 


Erample (1Q 70, Penmanship 30 by Gettysburg Seal 
Well since you left school every thing have being 
took off all the basket ball t four 
indoor 
N that we i ill ha 
busy witl work tl re not g ts , 
ean not di But to same it seem hard w 


Il. UNRELATED THOUGHTS on Plane of Mere Sensory P 

Tu} ! ENUMERATED SENSORY EXPERIENCES: UNRI 
BOTH IMMEDIATE AND REMOTE CONTEXT; CONTS 
CHANICAL, GRAMMATICAL, OR SPELLING ERRORS 


Example (1Q 88, Penmanship 30 by Gettysburg Seal 
fo-day at school we had what the | boys 
the best I seen so far I will see 
school lets out June 29. Have you still got your car, 


we cal to the camp we went last year .. 
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ENUMERATED SENSORY EXPERIENCES: UNRELATED TO 
BOTH IMMEDIATE AND REMOTE CONTEXT: CONTAIN NO 
MECHANICAL, GRAMMATICAL, OR SPELLING ERRORS WHICH 
DETRACT FROM THE MEANING 


Example (1Q 89, I ship 7 vy Gettysburg Sea 
I am busy studying for test Iam not graduation but I am g 
ng to transfer and I am going to summer si | to make up some 
of my poor grades. There are not many gr: tion compared with 
your school. I failed in my Science test and not doing very well 


in English and Spanish. 
11. RELATED THOUGHTS on Plane of Mere Sensory Perceptior 
SENSORY EXPERIENCES INCONSISTENTLY RELATED: CON 
TAIN MECHANICAL, GRAMMATICAL, AND SPELLING ERRORS 


( lonmanshin } ot ror Sen 
Era IQ 90, I y Gettysburg 
Last week at h we had the AY Class Play and next week 
at i to have the track 1 th fie] 
Jack Tavlor is tl inner of ( s nd he 1s 
going to Atlantic City this s r. Wel Ag picture 
tal last Thursday and we y t itt I ‘ it will 
be g 


SENSORY EXPERIENCES INCONSISTENTLY RELATED: CON 
TAIN NO MECHANICAL, GRAMMATICAL, OR SPELLING ER 
RORS WHICH DETRACT FROM THE MEANING 


IQ 112, Penmans ip «i Gettys Seal 

The class play wes very g it was called ‘‘ Four Little Maids 
evening It was a Tl s mack f +} 49 
ramatie class 

W hitle Park ¢ ntrv elub |} \ 
ice It is a Spanis il p st t 


out. 
SENSORY EXPERIENCES CONSISTENTLY RELATED; CONTAIN 
MECHANICAL, GRAMMATICAL, AND SPELLING ERRORS 


Erampl IQ 118, Penmanship ¢ Get g Seale 
You should have seer r pli Really it was unusually 
1 for High School I t g an 
Mavor of a city | ruess ther still char 


SENSORY EXPERIENCES CONSISTENTLY RELATED; CON 
rAINS NO MECHANICAL, GRAMMATICAL, OR SPELLING ER 
RORS WHICH DETRACT FROM THE MEANING 

Example (1Q 121, Penm: by Gettysbur 


inship GO hw Get Si 


‘ e that | m going ft f t te 
her Last ‘ I ore « ed 

pass hs h there 

is ti My ¢ f r in S } r 
this sur sO he i e for a 
while ilso 


REFLECTIVE THOUGHTS 
EXPERIENCE DESCRIPTIVELY ANALYZED: CONTAINS ER 
RORS IN MECHANICS, GRAMMAR, SPELLING, OR THOUGHT 
PROCESSES. 
Example IQ 152, Penmanship 50 by Gettysburg Seale 
Last Friday night, ‘‘ Weddy’’ and Dan and I went to see our A9 
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class play. We like it so well that I decided to write 
tell you about it I guess vou left before vou knew the 7 
the class plays Ill tell vou the reason for giving tl 
Type 2. EXPERIENCE DESCRIPTIVELY ANALYZED BUT FRI 
ERRORS 
Erample IQ 145. Penmanship 80 by Gettvsburg Seal 


Bet ur friend, a wrinkled old woman! That’s 
two weeks ago in a play at r auditoriun It was yg 
ilramatics class. It was in Chinese fashion, and I 
ildn‘’t have known me vith mv hair ip ul ler 
I had to s and crv. running all over the stage. It was] 


Type &. EXPERIENCE CAUSALLY ANALYZED; CONTAINS EI! 
MECHANICS, GRAMMAR, SPELLING, OR THOUG! 


ESSES 
vypotl tical 
For the first time T understood why water appears 

I’m wasting your time to tell but I i L 
eith here goes! Well, } ther 
8 trur ind that each col has a spe I i 
color having the shortest length is blue Now wl 
lig } s int il I tT wa the bl s being 
of ill hsorbed by the par les itte ( 
wat hil the wares ‘ re long 
reflected back. 


Type 4. EXPERIENCE CAUSALLY ANALYZED CONTAINING 
RORS 
Example Hvpothetieal) 


vanted to find ut just how n } lig t 3 Tracte 
depths of water. It is quite valuable to know tl 
trying to catch fish in clear water, o1 if you want tor 
thing from the bottom of a hod f water by sig 


diving. 
Level TV. CREATIVE THINKING 
Type 1. EXPERIENCE CON rAINING ORIGINAL REFLECTIVE A° 
BUT BEARING THE STAMP OF IMMATURITY. 


frample Hypothetical) 
Jane, dent I evel feel as I do? pometin 
at the millions of lights down ir the valley below us at 
frightened and wonder why a thing so insignificant 
permitted to ur lerstand the meaning of that vast arr: 
man made those lights and the mighty cities whicl 


What marvelous cooperation the good Lord inspires in s 
ereatures. 


Type 2. EXPERIENCE CONTAINING ORIGINAL REFLECTIV] 


SIS IN THE FORM OF SPECIAL THOUGHT CON\ 


DEVICES 

Such as figures of speech) 

Example 

Not far from us here, there is a beautiful little 

has been famous or rather notorious, because of the g 
located a few miles back in the mountains. But last nig 
Dam broke and a mighty flood swept down the ca 
forests and leaving no trace of the habitat of 
seemed as if the gods were reeking their vengeance upor 
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in junior high school alone, but in senior high school and college as well 
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and filthy den .... When morning me, the waters were gone, and 
a deadly stillness hung as a p: ipon the path, as it f tl 
monster.... At last, the littl 

but only after man is gone Indeed, this w i be a love \ ld if 


we humans did not mar its beaut 
EXPERIENCE CONTAINING ORIGINAL REFLECTIVE EXCEL 
LENCE TO THE EXTENT OF A REAL CONTRIBUTION TO 
LITERATURE, 
Example (Hypothetical 


Mother, perhaps I am antisocial, but there is much in this 
of existence which causes me to question its e as training f 
manhood’s tasks. Last night I wrote thes nes after I returned 


from the Grand Ball 


DISAPPOINTMENT 


My heart was bent on gladness 


hess ‘‘eriteria’’ are by no means set up as final. The re ar prob 


pler ways of stating the meanings comprehended by them, as, 
there are doubtless better wavs of Classify ing the levels of thought 


xity themselves. In fact, this is merely an original effort in a 


tively unknown. Just as long as teachers must eva ate sub 
written English there will be need for criteria of this coneral 
and the sooner some one produce sa usable vuide, the better 


writer, in this instance, solicits communication with anv person 


may use these ‘‘eriteria’’ in the evaluation of composition work, not 


- 
a) 
A 
But the gladness turned to sorrow 3x cis 
And a dirge was all that ‘ ay 
From the ten ple of my soul ia 
i” 
I 
ve 


A SIMPLE TECHNIQUE FOR DETERMINING WHETHER 
CHILDREN KNOW THE MEANING OF SPELLING WORDs 


CARLETON WASHBURNI 
Superintendent of Schools 
and 
MaBEL VOGEL MoRPHE’ 
Director of Research Department, Winnetka, Illinois 


In the grade placement of spelling words their spelling diffic 


usually been made the prineipal eriterion. As a secondary ¢ 
frequency of use as shown by such studies of adult usage as tf] 


dike’ and the Horn? Word Lists has been considered. Some 


. ] 
ilso been made occasionally of the so far inadequate invest 


4 


children’s written and spoken vocabularies. We have not know: 
ever, which spelling words in the list of any grade were reall 
the vocabulary of the children who wer expected to learn to s) 
Since the words included in any scientifically constructs 
such “As the llorn-Ashhbau he or Ind vidual Spell rt, havi bes n ¢! 
the basis of careful studies of probable ultimate utility to the « 
who are to learn them, it certamly is desirable that the childrer 
know the meaning of these words. It is palpably absurd to tr: 


dren to spell a word correctly when they do not know its meaning 


the other hand, it is a distinct waste of time to give children \ 


drills and training on words which are already perfectly fan 


them It is, therefore, hig! ly desirable to discover which of the 


included in any spelling list are within the vocabulary of th: 


who are to study this list and which words are unknown to 
of the children and consequently require special v@eabulary dri 
It is the purpose of this article to describe a technique whi 


proved to be both reliable and valid for determining which w 


any given spelling list are familiar or unfamiliar to childre 


rrade for which the list is intended. B 


The simplest possible method of determining which words ar 


‘Thorndike, E. L. The Teacher’s Word Book. New York City. Te: 
lege, Bureau of Publieations, Columbia Ur iversity, 1921 

‘Horn, Ernest. University of Iowa Monograph Education. Coll 
eation, University of Iowa, Ay ril, 1926, 

*Ashbaugh, Ernest, and Horn, Ernest. Lippincott Horn—Ashbaugh Spe 
J. B. Lippineott Co., 1920 

*Washburne, Carleton W. Washburne Individual S} ller. Yonkers H 
New York, World Book Company, and ‘‘A Spelling Curriculum Based on Ri 
Elementary School Journal, June, 1923. 
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irv ol the children is to have | lren check « i list 

s which they find unfamiliar. Is this method reliable and valid? 
nswer this question seven Winnetka fifth-grade teachers® took 
37 words each from the four fifth-grade lists in the Individual 
rhree of the t hers dictated ¢ mn | their fifth-grade 
each eh having a copy ¢columl ront } In at the 

dit Kach tu vord unfamiliar to child was 
that child raised his hand I} teach hereto simply 
number of raised hands and rece anv children 
eiven word as unfamiliar teach en dietated Col 

the children, but esl ld plaee a eneck 

te an word hat | ‘ Sicle rer niam so as tO avoid 
sible fluence of suggestion from the other childre: The other 
rl | { ehe earl ed ‘ { it 
ehildren placed check marks opposite untamillar words of Col 
1 raised their hands for the unfamiliar words in Column II 


cheeked words were tabulated uva words lor whieh ehil 


d then hands. It was found th if, with ve ry lew execptions, the 


had indicated the same words as unfamiliar regardless of 
e hand-raising technique or checking technique was used. It 
so found that, with great uniformity the same words were indi 


infamiliar by a fair number of children in each of the seven 

Certain words were never reported by a single child as un 
Other words were reported by a tew children in ev ry room 
ar; while still others were indicated as unfamiliar by a con 
number of children in each room 

] 


fhe uniformity of these results indieated that fifth-grade children 


nsistent by either the hand-raising or checking technique in in 
yx the words the meanings of which they knew or did not know 
ese techniques, therefore, appeared to be reliable. 
The validity of the checking technique was next investigated. A list 
rds was so chosen from the fifth-grade spelling list as to include 
s which were almost sure to be unfamiliar to the children and words 


were equally sure to be familiar. The fifth-grade teachers pre 


1 a vocabulary test for each of these 50 words, the test being in 
llowing form: 
*M Herrick, Helen Sparks, Julia Krenwinkel, Ruth MeNamara, Eva Cox 


Leap, Ethel Theis. 
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The climate of a country is (the weather) (the height of t} 


building the kind of churches) (the kind of roads) the wa 
the people dress) 

To continue means (to go on) (to stop) (to listen) (to 
full News sent from one person to another is (a wish 
stage) (a master) (a message) (a bank 


The fifty words for which such tests had been prepared wi 
mimeographed in a simple list. This list was given to all third-. { 
and fifth-grade children in Winnetka (452 children ). \ similar 
somewhat more difficult words was given to all sixth-grade 
(167). The children were asked to eheck each word with whi 
were unfamiliar. They were not told that their knowledge of thes: 
was going to be tested. The lists were then collected, and the vox 
tests on the same words were distributed to the children. On the 
lary tests, the children underlined the correct answer and th 
were again collected. 

All pairs of papers—the checked list and the vocabulary t 
turned over to the Research Office for comparison and tabulatio: 

Table I shows the result of the comparison. It will be n 


TABLE I 
PERCENT OF AGREEMENT BETWEEN CHECKED WorpD Lists AND VOCAB 
PERCENT CH&CKED UN PERCENT N ( 
PERCENT OF FAMILIAR BUT CORRECT UNFAMILIAI \ 
GRADE AGREEMENT In Test CORRECT 
3 73 15 
4 80 10 4 
5 7 7 [3 
6 86 6 8 
the percentage of agreement is reasonably high from the lowest 2 
and steadily improves. It will also be noted that in nearly half the cases 
of disagreement between the cheeked list and the vocabulary test 
child has thought he was unfamiliar with the word and yet has bee 
able to recognize the correct meaning in a multiple choice test. Th 


of course, to be expe ected. Reeognition requires less thorough famil 
with the word than does reeall. The disagreements under this heading 
therefore, can scarcely be considered as true inconsistencies. The last 
column alone, represented by 15 percent of the third grade, but 
9 percent, 7 percent, and 8 percent in the fourth-, fifth-, and 
grades, indicates any true lack of consistency between the children’s 
judgments as to their familiarity with the words and their actual fa 


miliarity as shown by tests. 


if 
ne 
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further check on the validity of children’s judgments in deter 
y tne unfamiliarity of a word, a coefticient of correlation Was found 
the total number of times a word was marked unfamiliar by 
n grades three, four, and five, and the number of times it Was 
be unknown in the vocabulary test given to these same chil 
The coefficient of correlation was .92. Had third grade been 
this correlation would, of course, have been even higher 
therefore evident that it is not necessary to give an elaborate 
test to children in order to determine which of their spelling 
re familiar to them. The simple technique of having each child 
his speller those words with which he is unfamiliar is sur 
reliable and valid. 
‘hnique applied to the Individual Spell ‘showed that 11.6 per 
the words in the fourth-, fifth-, and sixth-grade lists were un 
to at least 17 percent and usually 25 percent or more of the 
in the respective grades. In the fourth vrade spelling list of 
rds, for example, there are 86 words, which are sufficiently easy 
to belong in fourth-grade but which should receive special voeabu 
before the children are asked to spell them 


ry speller should undergo careful analysis to discover unfamiliar 


so that vocabulary drill may be provided. The technique is simple 
classroom teacher can apply it. Yet it iss irprisingly reliable. 

risk of repetition, the technique may be summarized as follows: 
lake the children into your confidence. Say something like this: 
ve teaching you to spell the words in your speller, I want to be 
uu know what they mean. But I don’t want to waste your time 
ng you the meaning of words you already understand. So as I 
you don’t 


ese words to you, look at them in your spe llers If 


what a word means, raise your hand. “Don’t pay attention to other 


ren to see whether they are raising theirs, but let me know your 


ionest opinion. There is nothing wrong about not knowing what 
1 means. But it is harmful not to admit that you don’t know, 
se then you can’t get help. So raise your hand whenever you don’t 
the meaning of a word.’’ 

Dictate the words of the entire grade’s list, in a series of 10-minute 


tions. Pronounce each word clearly, then pause a moment to let 


hildren raise their hands. Record the number of hands raised. in 


own desk copy of the speller. 
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af \ ‘hildren should not 


wh 


3. Compare, if possible, your marked speller with that of ot! 
. ers of the same grade. Poo! your results. The more classes in 
ol more generally reliable the data, provided the classes are s ‘ 
be nearly alike A elass made up largely of children of foreig ‘ 
| instance, would not, however, be fairly rated if averaged in wit} ‘ 
f children from English speanking homes, and ie versa 
a. 1 In general, the meaning of any word that is unknown t 
C cent of the children had better be taught. A good many othe: 
el probably won't know the word any too weil. Therefore, prep 
ae ( infamiliar vords from the list for the grade you teach, a 
' r CO) lered u r if 25 pereent or more of the childre 
know what it mean This list should be preserved and used from 
: it is not ne . ry to repeat the techn que Ca h vear, ¢ 
| infamiliar’’ list is made from the pooled results ¢ 
teachers’ work 
3 5. Teach the children, each vear, the meaning of the ‘‘unfar 
words in their spelling lists, before you test or teach ability to s; 
be taught to spell words which. to 1 
a I 
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OBJECTIVE SUPERVISION 
nent of Supe rvisors and Directors of Instruction of the 
Association have just publis| ed a vearbook on 
ic Method Supervision This yearbook deseribe 
systen atically the several! objective devices now available 
ta about classroom instruction: The 
ivity analyse Ss, teacher’s di 
contribution of tl 
objective data-g 
rvision. 
any supervisors realize the complete imadequacy 
ethods of classroom supervision, In analy Zing teae 
littl agrecmenht among supers isors 
furthe rmore the 
IS highly subjective, 
has proposed a n 
ime goes on, will more { nd 


d of this vearbook, rticulé I en phasis upon 
supervision. There is, however, a danger or an inadequacy 
ve supervision. Supervision is not scintifi ly beeause 

It is quite possible that objectiy ervision nN it 
the facts and that it may MISUSE the facts gotten. Objective 


ring such as time and frequency activity analyses merely show 
hers and pupils do. They do not indicat the goodness o1 
activity observed. This is done by 


have facts objectively colleeted bie 


nd objective supervision that is unscientific. The point is not 


should avoid objective supervision, but that we should use 


wis a3 
= 
tos 
pate 
Ns 
‘ 
( ot 
t] 
Method n Sunervis n.?? The Sreond } irhook of the Nat 
Supers md D tors of Instruction, New York: Bureau of Publica Sins. 
‘ ers College. Columbia University, 1929 ar 
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jective data with care and build up the necessary supplementary 
niques to make objective supervision more scientific. 

The realization that current supervision is highly subjective 
brought forth a whole new crop of data-gathering devises. These 
gathering devices are very much like so many new tests and need t 
evaluated as to their validity, reliability, and objectivity. Super 
will need to exercise extreme care in selecting the data-gathering de 
to be used by them in classroom supervision. The fact that sor 
says that a given device is valuable does not necessarily make it si 
device for collecting data about teaching should be used only “ 
is shown to bear a definite relationship to good teaching, when t! 


formance is sufficiently constant from day to day to make reliabl 


ments about it possible, and when the facts collected are sufficient 


objective to make it possible for two or more independent obsery 
arrive at substantially the same conclusion. 


The seeond vearbook of the De partment of Supe rvisors and Dir 


of Instruction has made a distinct contribution to scientifie supervis 


particularly in describing new and objective data-gathering device 


use in classroom supe vision. Two facts, however, stand out, (and thes 


are pointed out in the yearbook itself); first, that it is quite poss 
have objectively collected data and subjectively interpreted, and 


sequently unscientific supervision; and second, that data gathering 


vices need to be evaluated for validity, reliability and objectivity. 
A. 5S. B 
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J. Ashbaugh, Ohio State University, Columbus, Ohio. 


Heserr Current Prob- 
the Supervision of Instruction. 
, York: Johnson Publishing Com 


1928. xiv + 538 pp. 


and suggestive 


ok is valuable 
particulars. 
a Codes of Ethics in Supervision for 
and the 


licate clearly the cooperative, 


tly th ft supervisor teacher 
and human bases for supervision. 


bjectives of supervisions are 


hensive, clear-cut and valuable. 
in of definitely applying general 
. sory objectives to individual sub- 


especially helpful. 


mproved by 


These might 
greater attention 
hild and his interests and needs. 
the most valuable phase of the 
's objectives in supervision is his 

to teacher growth. He 


states 


such teachers (those receiving the 
kind of supervision) will grow 
and more expert d agnosticians 


killed in 


more and more 


teaching procedures that meet 


ex teaching situation ade 


thor’s discussion of the place of 


pal in a 


with the 


supervisory program 


irding the I ne ipa sh | The 
of the types of principals, 
seleetion and promotion points the 


vard better principalships. He 


have stressed more the specific 


z for the principalship which 


professional institutions are 
Nutt’s 


ding. Dr. outline of 


203 


suggestive duties for the principal 
is not an expert in certain subjects would 


be improved by an item calling attention 


to the principal’s function as a sup 
visor of the technique and psychology of 
instruction. 

The improvement of supervisors in 


t) 


service 1s an important 
hook. 
Another im] 


ea 
rtant element is the 
classification of plans by size of cities. 
organization of some large 
school 


The plan of 
cannot be 
The book thus 


various 


progressive systems 


applied to smaller places 


shows the current tendencies in 


types of 


situations. 
npilation of duties assigned to 


principals and supervisors in various 


lack of 


clear-cut conception of supervision and 


of the democratic methods of conducting 


It also shows 


cooperative 


a lack of conception of the principal as 
his schor l and 


conception of the supervisor as 


supervision. 


a director of education in 
a lack of 
an expert to assist the principal and the 


teachers in solving their problems. 


further shows a 


type of 
formalism which rarely results in teacher 
rowth as suggested by Dr. Nutt in his 
objectives. 

The book is a valuable contribution to 


the field of supervision. 


ArtHvUR 8. Gist 
State Poachers College 


San Fra nerweco, Caisf. 
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Amateur 


The 


s and Sports 


DERICK 


ROGERS, FRI RAND 


Spirit in Scholastic Game 


Albany, New York: C. F. Williams and 

Son, 1929. 148 pp 

The author of this little book is one of 
the leaders in the field of health and 
physical education who see athletics from 
an educati standpoint. Believing 
firmly in the neient doctrine that one 


learns to do by dotng, and finding ample 


and lern philosophers and of present 
day psyel sts for his point of view, 
he has been earnestly eking a way by 
which athletic games ld give to the 
participants the maximum edueational 
value. He believes he has found this by 


returning the me to the players; by 


giving the s the opportunity of 
ren tl r dec sions during the 
progress of the game, and placing upon 
them full responsibility for these de- 


nplished by taking 


the coach awa from the side-lines and 
making it impossible for him to domi 
nate | riy instructions through sub 
stitutes and signals 

In this little volume, Dr. Rogers has 


presented the ‘‘General Regulation’’ 
which expresses this principle which was 
lopted this past vear by The New York 
State Public High School Athletic Asso 
eation and tells of the progress made in 
New York State during the current year. 
He discusses quite completely the pre 
requisites to amateurism, quoting freely 
from philosophers, psychologists and edu- 
cators in support of the principle. He 
presents in Part Two, four most in 

t sting chapters under the general title 


of The Amateur Spirit—Points of View 


These chapters deal with Fair Play, Vic 
tory, Competition, and Amateurism 
Each of these ideas is discussed clearlv 
with respect to athletics and education 


The volume is presented in the hope 


OF EDUCATIONAL 


RESEARCH | Fol. 19, N 


clearer 


that a 


New York State is doing in this 


understanding of 
may influence the school people of 
their at} 
more educative through pupil inst 
The fact that t} 


states to likewise render 


coach control 


ciple has worked successfully 
vear in a large number of cont 
large cities and small, in sect 


state tournaments, together wit 


fact that the chief objections are 


met and well-disposed of from 


tional standpoint, should make tl 


ume of special interest to school 
intendents and high-school | 
everywhere. It might even be |} 
that those in charge of college at! 


thro 


uate 


ighout the nation 


athletics in their respective instit 


might als 


tions in terms of the principles set forth 


E. J. ASHBAt 
Ohio State University 
L. Aptitude Ter 
Yonkers-on-Hudson, New York: Vi 
Book Co., 1928, xiv + 535 pp 
In this timely volume, the tec 
procedures of test making and of 
tude prediction are made availa 
With the a 


and 60 


those who can read. 


numbered tables figures 
four lengt! 


useful tables in the appendix, a 


text and in addition 
mysteries are patiently revealed, st 
for the laymar 
the specialist will find much of 


step. It is written 
its closely packed pages for its met 
The a 


view of testir 


have general application. 
tukes the 
Anything is a good test whic 


empirical 


reliably and cheaply enough meas 


the light of its contribution to a tt 


for predicting an independent crit 
of the aptitude in question. A 
theoretical aspects are made clear 


only treatise known to the writer » 


| 
what 
ties 
f 
rir 
H 
ng 
ne 
‘s 
ub 
th 
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ip factors or determiners, 


hance, correlations among 


s—all elucidated with a little 
ebra The several chapters on 

und other alleged signs of 
the basie constitution of apti 
tests combi ng the tests to 

max m forecasting effi 
contain permanent contribu- 


field of testing 


ver regrets that more refer 
he original sources of the for 
e not provided; it contains 
hy of 105 titles); also that 
refrained from speculating as 
e of aptitude ‘‘ determin ra’? 
} sly they are but means 


Human aptitude acts ‘‘as tf 
sed of, or deper 


othetiea! 


lent upor 
‘ 1] 


entities 


graphical errors have crept 


f which, read in connection 


imerieal examples given, will 


s error with the possible ex 
t in formula (15), page 397, 
sign should be attached to the 
merator rather than to the de 


As a 


propheey of 


rosy. but eminently 


the future, we 


ay make aptitude forecasts 
na machine which grinds 


itieally when finished! Three 
nes have been made and they 


HERBERT A. 
University 
, AND WEBER, 
School 


Ht 


Doran 


New 
& Company, 


1928. 


icher Training Series. 


e second hook of a series of 
mes planned by Dr. W. 8. 
series of texts 

This volum« 


high 


a codrdinated 
ld of education. 


written primarily for 
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teachers ar 1 19 des gned to give 


an uaintance with the significant facts 
bout high school as a unit in r edu 
entionel systen The se pe f the book 


is suggested in the following 


with which the authors open their first 
chapter: ‘*What should the cher 


it the high school as an e& 


tional institut ng??? There are 8 ngle 
ec} pters on ‘* The Development of Sec 


England 


ir’ 
rar nd Germany,’’ ‘‘ The Downward 
and Upward Extension of the High 
Sch * lg and two chapters on the ol 
eetives of the secondary choo] T} 
problems of the eurriculur " riven 
more extended treatment thar ther 
problems, and the materials ine!:ded are 
chosen so as to help the teacher ‘‘main 


tain the right attitude toward proposals 


for changes and be a 


The topics of 


ies’’ and a few of 


e to evaluate them 


wisely.’’ ‘* xtra-cur 


the 


portant administrative problems 


ire given brief treatment 
In writing the book the thors have 
lrawn very extensively on spe 1 studies 


and the reports of national cor 


The treat nt throuc!} t is 
torical The learning exercises at the 
clos of the ch pters constit e one of 
he most helpful features of the book 
These present a _ sufficient variety of 
problems and questions to make it com 

easy for a skillful teacher to 


encourage wide reading and to stimulate 


In all prol abil ty there are some who 
would criticize the book on the score that 
t presents only a survey of materials 
from the fields of hint ry of education. 
philosophy of edueation, the curriculum 

iministration nd gu lance It a my 
pinion, however that the authors 
sh uuld be commended for undertaking 


the preparation of a for an intro 


: 
Gai}. 
ties h, 
th or 
ng ‘ riecular A 
rid t nore (1) 
> wh en 
State 
is 
Doul 
e 
he 
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ductory course. We need the highly 
specialized books for our advanced stu 
dents, but our beginning students need 
texts that will give them a professional 


outlook upon the essential problems of 
the larger units of our educational 
system. 

J. B. EDMONSON 
niversity of Michiqan 


Leta S. The Psychol 
oayu of the Adolescent. New York: 
D. Appleton & Co., 1928. 253 pp. 

to the author of this book, 
it was written to make the intelligent 
youths who are actually in the midst of 
the adolescent adjustments deseribed 
realize that the experiences they ar 
going thro ich are both normal and uni 
versal, and to give to parents and teach 
ers who have the responsibility of di 
recting these young people a_ clearer 
knowledge of the adjustments through 
which ‘‘the boy or girl in the ‘teens’ is 
passing.’’ With this object in mind, 
and endowed with the belief that the 
right sort of help can only be given by 
parents and teachers when adolescence 
is foreseen in the rearing and education 
of the infant and child, the author pro 
ceeds to discuss for parents, youths, and 
teachers what she regards as the uni 
versal problems of this period of dk 
velopment. 

What the author of this book regards 
as the outstanding problems of the adol- 
escent period of development may he 
sensed hy quoting the chapter headings 
under which these problems are dis 
eussed; namely, ‘‘ Psychological Wean 
ing,’’ ‘‘Seeking Self-Support,’’ ‘‘ Mat 
ing,’’ ‘‘Achieving a Point of View,’’ 
‘‘The Meaning of Maturity,’’ and 
‘*Finding the Self.’’ These problems 
are discussed in a superficial but enter 
taining way that will prove helpful to 


parents and many young people. But 


the serious student of Genetie Ps 
ogy will experience great disappointmen: 
in this author’s treatment of tl 

and important period in humar 

A ] 


dividual development. 


No attempt is made to pr + + 4+ 
facts recently ascertained al 
stage of development in t 


what has already been detern 


the field. That many new met! 


techniques have been developed 2 n 
the past twenty-five years that 
used to study the prot lems it 

and that much quantitative mater 

already been collected that bears t x! 
on this important stage of d: 

the author of this text is aware, g 
tle of this material is assembled t Sne 
terpreted in the light of pres s 
vestigations. The book is, in 


mere formulation of some of tl 
lems of the adolescent, ‘‘as ther 


at present, under conditions 


porary life.’’ As such, it will 
be valuable to teachers and par 
seem to be adverse to reading or st 
anything that is scientific or t! 

The author has, therefore, ga 
together some data, set forth a 
torical facts and brought to n 
of the problems of adolescet 
effort to shock the ‘‘ guardians 
into a realization of the seriousness 
these problems. In this she 
ceeded, for her style is both 
entertaining But as a text 1 
chology of Adolescence, the |} 


be classed as a failure. 


WILLIAM FREDERICK ! 
Indiana Unwersity 
SNEDDEN, Davip. Educational 
for Beginners. New York: T! M 


millan Company, 1928. xii 


We might expect one who has entered 


tered 


: the laws and principles of indir f 
velopment bv previous investicat 5 
ppear this 
nt 
He gs won 
gall 
pro! 
true 
ffe 
eral 
| f well 
te 
ney 
trea 
Dr 
9 


sociology from the field of 
to give particular attention to 
roblems; but Dr. Snedden 
k for beginners has been pri 
problems. 


rned with social 


At st three-fourths of his more than 
ges is taken up with sociological 
sions. Not even Dr. Ross has in 


nto his writings a wider range 


materials which throw 


trative 


the moving currents of con 


civilization. In fact, there 
may be some danger lest the wealth of 
sllusion and shrewd comment may tend 


vilder rather than clarify the 

nking of many of the unlearned for 
xt it was written. 

ry chapter in the book is stimulat 

of Dr. 


content is 


illuminating. As in all 


Snedden’s recent work, the 


nsely analytical. It is question 
raising rather than problem-solving. In 
the present state of educational sociology 


but it 
nvolves considerable repetition and one 


this may be the better technique; 
wonders whether the beginner might not 
gain more help from a more synthetic 
and constructive treatment of his actual 
It is 
being 


problems than is here attempted. 
true that many 


fered courses in educational sociology 


students are 


have not had previous work in gen- 
Yet the growth of so 
schools, as 
as in colleges and universities, has 
so rapid that the present writer 


80 
clology 


} 


in normal 


study 


time has arrived when the edu 


sociologist can devote his time 
to the sociological treatment of 
ational problems as the educational 
gist does to the 


ment of the 


psychological 


same or. similar 


ng the several texts recently pub 
none are more thought provoking 
Dr. Snedden’s and it will, without 
n, find a useful place in educa- 


BEVIEWS 


tional classes. It is well equipped wit! 
problem questions and suggestive read 
ings 
WALTER R. Smit 

Unwersity of Kansas 
McA r-O Child Accounting 

Practice \ s-on-Hudso Nev 

k World RB k Company 1927 

X11 196 py 

‘*Child Accounting Practice’’ dis 
cusses each of its four units a distinct 
problem in accounting for the pupils of 
a school system The first unit raises 
the general question as to what is the 
purpose of such work; it discusses gen 
eral principles that pertain to the field; 
and explains in detail the purpose and 


McAllister-Otis Child Ac 


System Unit Two describes 


counting 


for the teacher her part in child aeccoun 


ing. Sample forms are shown, their pur 
de tailed 


using the forms are 


and the 


poses are discu 


té chnique s needed in 


described in great detail. Such tasks as 


keeping the class roll, recording attend 


ance, recording scholarship, recording 
test scores, making permanent cumula 
tive records, and making reports are 


considered. 
Unit Three describes the principal’s 
child 


forms 


accounting. Samples of 
needed by the 
records 


part in 
those which are 
principal are shown; these are 
of character ratings and of health, and 
be sent to the super 


Such tasks as super- 


reports which are to 


‘ 
ntendent’s office. 


vising the work of his teachers in child 
accounting, record ratings on character 
traits, recording health data, summariz 


ing the reports of his teachers, and 


making the ‘‘ Administrative Report’’ to 


the superintendent’s office are described 
Unit Four 


central office in 


in detail. outlines the work 


of the relation to child 


The 


accurate 


involved in pro 


census, 10 


work 


accounting 
accounting 


viding an school 
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keeping track of individual pupils and 
in filing school records and reports 1s 
analyzed for the reader 

The authors have set a standard of 
excellence which writers in the field of 
child accounting cannot ignore in tl 
future; they have not been content to 
name a series of record and report forms 
and call such a series a system; thes 
have developed each form in relation to 
the other forms of the system; they 
have provided a detailed description of 
how each unit of their system is to be 
used by teacher, principal, and central 
office; and they have shown why they 
believe each form in the system 1s neces- 
sary. Most systems of child accounting 
forms seem to assume that the technique 
of using the forms is entirely obvious 
from an examination of the forms them 
selves Until this misapprehension is 


ild 


accounting systems refuse to leave a defi 


displaced and until formulators of cl 
itely technical procedure to chance, 
child accounting practices will continue 


to be non-uniform, inaccurate, and in 
many Ways of little worth. It is with 
pleasure that I review a book that has 
made a contribution of this nature. 

It seems almost out of place to offer 
a criticism where such a contribution has 
heen made. If I may be indulged, how- 
ever, I will offer three—one minor and 
two major. The authors suggest that 
‘*whenever a pupil has been absent more 
than six consecutive half days, he should 
he dropped from the roll.’’ For a book 
with so many progressive features in it, 
it seems a bit disappointing that this 
rather vicious rule governing the record- 
ing of attendance should be given further 
«neouragement The authors at least 
partly justify the rule upon the basis 
of the old recommendation of the 
N. E. A. Committee report on Uniform 
Records and Reports of 1912. The more 


recent report of the N. E. A. Committee 


on Uniform Records and Rey 
1928 repudiates this rule. 
the authors, the latter report 
lished after their hook eame f 
press. 

‘‘Child Accounting Practic 
doubtedly intended as a hand 
the teacher. The authors sa 
viously you (addressing the tea 
find it of advantage also t 
copy of this Manual Y 
study of it will make your child 
ing work a delight to you 
questione i whether the teacher 
tle or no training in child a 
read easily the somewhat te 


scriptions of forms and pr 
terms, a number of syml ols, 


tinual reference to additional 


to footnotes for a proper u lerst 
of given points, at times n kes 
reading of the manual a little dif 


As a cuide for the techniciar 


the work is excellent 


ance 4 


Again one slightly 


when the items upon the 


pupil records are reviewed 
emphasis upon guidance fr 
seventh through the twelfth gr 


mands a wealth of detail at 


vidual. The system would seer 


the counting aspects of child 
somewhat at the expense of its 


aspects. In spite of these poss 
cisms, the book is a decided contri! 
to the field of child accounting 
reviewer hopes that MeAllister 
will continue their contributions 


field. 
Ohio State University 


New York Society FoR THE EX 
MENTAL Stupy oF EDUCATI 
tributions to Education, Vo! 
Part I, ‘‘Experiments in the ( 

room,’’ edited by J. Carleton B 


3 
in fi 
the inc 
1 Otis 
5 
a 
} 
Cu 
TT 


and Part II, ‘‘Problems in Teacher 
Training,’’ edited by Ambrose L. 
Yonkers-on-Hudson, New 
Book ¢ pry 1028 
x + 425 pp. 
olume, like Volume I, is a tribute 
the inspirational and directive in 
e of Professor J. Carleton Bell, 
founder of the New York Society for 
xperimental Study of Education, 
nd its executive secretary during the 
years in which its membership has 
74 to 1500. 


nte of studies 


from Twenty-six ac- 


and observations car- 
classroom teachers are re- 


In nearly all of these 


i on by 
Part I. 
es at least one standard intelligence 


sted in 


ducational measure has been em 


Pat ¢ t 
With a few exceptions, the papers 
present little or no contribution to 


ie or scientific knowledge; nor 


he authors pretend to make such 


These 


represent a real step forward since 


itions. studies do, how 
were carried on by classroom teach 
nd in most cases by teachers who 


irily are considered laymen in edu- 


il research. Some of the most 
le research of the future is, doubt 
lestined to emanate from this 

as Buckingham has strongly 


1 in his editorials and in his book, 


irch for Teachers. Such studies will 


bly do more to stimulate an ex 
ntal attitude on the part of the 
rs than will the more refined re 


es from the laboratories of skilled 
ans. The spread of an epidemic 
1g classroom teachers of searching 
jective information regarding how 
thildren learn, their specific diffi- 
es, failures, and successes, will re- 


in marked improvement in the art 
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at a conference, descriptive of the various 
phases of work carried on by the leading 
teacher-training 

such 


reports are made of the practice in that 


eastern metitutions 


From each of several institutions 


school concerning such subjects as meth 
ods of selecting students for admission, 


plans for helping students make up 


deficiencies discovered in their prepara 
tion after admission, content and con 
duct of courses in the ‘‘introduction of 
teaching,’’ the 


student teaching, procedure for eliminat 


teacher's personality, 


ing the unfit, appointment and super 


vision of beginning teachers, student 
government, and student-faculty codpera 
Dr. Suhrie, II, re 


veals the always 


who edits Part 
which has 


his efforts in teaching and 


tion. 


vision 


racterized 


school administration 
GARRY C. MYERS 

Cleveland School of Education 
FITZPATRICK, EDWARD A.,. AND HvUTSON 

PeERCIVAL W The Scholarship of 

Teachers in Secondary Schools. New 

\I 

208 pp 

Iwo essays quit different in char 
eter, which were presented in competi 
tion for the Sachs Prize of 1926 are 
found in this book Together th con 
itute probat aS ¢ prehensive and as 
p-to-date a discussion on the sch arship 
f secondary-school teachers as one can 
find. The winr r essay by Dean Fitz 
patrick surveys briefly the essential 


bearing upon the scholarship of 
attempts in a con 
structive and fundamental way to present 
training. It 
finds in the that 
ean be adopted profitably in this country. 
Hutson’s contribution, on the other hand, 
a factual study with 


a new policy in teacher 


German system much 


is quite largely 


concisely stated recommendations based 
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pon facts laboriously accumulated. The American and Canadian Commit 
lifference between the two studies is Modern Languages. New Y 


well illustrated when each considers the Macmillan Company, 1927. wx 


functions of teacher-training schools 339 pp. 
Fitzpatrick asks and attempts to answer As volume one of the above im 


the question, ‘‘ What should the teachers series of publications Professor By 
colleges do?’’ Hutson examines the Wood’s ‘‘New York Experim 
catalogues of training institutions in the New-Type Modern Langua 


g guag 
order t etermine what they e doing has particular significance for t 
I 1 re ‘ howe the present of schools and colleges as we 
patchwork preparation as an evil, and linguists and educationalists. It 
thus bot! me face to face with the in a striking manner a spl 
necessity for a more liberal professional laboration between the adn 
training This prot pts Hutson to st idy officers of the school system 
the present relationship between the metropolitan center and in an 
courses taken in college by teachers and = state and the corps of inves 
the subjects which they teach. It without which no worth whil 
; pts Fitzpatrick to inquire as to on a large scale is possible 
what constitutes a liberal preparation praiseworthy example that mig 
for teaching In this way each writer ably be imitated by other cit 
approaches somewhat diffe rently the state systems. Also by tl 
problem of professionalizing subject method of inquiry employed 
matter for the training of teachers. frank presentation of its dis 
Neither, however, bores as extensively as seems to promise that the wl 
he might into the rich possibilities of of the nvestigation by the St 
this question be away from the empirical 
Space will not permit us to compare the direction of the scient 
fully the y nte f agreement and dif as it should be, because heret 
ferences in the two discussions Both gvether t many of our oy 
admire the California requirement of decisions about matters pert 
one year of graduate work for secondary our field have been establishe 
echool teachers: both see the continua jective rather than on objec 
tion of the small high school as a con and hence to be deprecated 
stant source of infection; both insist As shown by the title page, P 
that improvement is abs lutely depend Wood’s monograph really 
ent upon a better coérdinated and more three different experiments, nar 
concentrated type of training prior to a Survey of Modern Language A 


teaching in the subjects to be taught; ment in the Junior High Schools 

and both insist that teachers be com- York; (2) the Regents Exper 
etent to give instruction in three high June, 1925, with the New-Ty] 
ool subiects. French, German, Spanish and 

V. T. THAYER and }) a Second Survey 

Ohio State University Language Achievement in 

High Schools of New York Cit 


Woon, Ben D. New York Experiments 1926. Some of the principal 


the 


with Vew-T ype Vodern Lanquage of each report are summarizé 
Tests, Vol. I, Publications of the tl 
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PART ONE taken In this connection the 


Writes IS: 
riment in the Junior High 
New Voth ia Jen. 1008 ox From the graphs for all the French 


classes therefore, w leari that over 
1 Vv h what are now known in 000 of the nearly 194 j ar high 
sed form as the American school French students are misplaced by 
French and Spanish Tests, a Whole sen more, and that af 
proximately 10,000 of them are nearer to 
‘ es of which were em : 
a higher or lower class-aver: ge than to 
this occasion. rhe author the average of the ass n wi h they 
the greater part of five chapters were reciting during the spring of 192 
yt construction and valida 
Pt, emonstrating that thie same 
tests, setting forth the re \ 
f classification 
1 with the same, making an af ~ ivy i ex 
‘ ditke, es estere oft the 
f the difficulties of the ques 
r } ; ther ly ivestigator traces back t rigin of 
ng the tests themselves, 
the trouble to the sel which fers 
ending certain remedial at 
A ti oa rhe “al ther at ] is yf 
the light of his findings. In 
work a half year and even a whole vear 
he first point the reader is 
Results like these show the ‘ f sound 
at the new tests were made 
classification ~ ents sed 
r years experimentation and 
h el t i sul t ather nan 
a vocabulary part of the 
I nits Of time ar l the sub tective 
jee type, a comprehension - 
form of examinin 1 gr It is 
f the multiple choice type, 
. to the credit of thos n charge f the 
mar part of the completion me ee 
modern languages in tl wnior high 
re being 220 items in the French g 
schools of New York that a reclassifica 
225 in the Spanish. The re 
7 t 1 of all students that took these testa 
etheient of both tests, each 
is sk 
eases, stepped up by the 
Brown Formula is .97 as com 
however, that the full advanta 
th .SO, the estimated maximum 
ne ] ld not he tal 
r the old-type modern lan 
I nistrat ‘ eXiy a ties 
nation, according to Profes 
otion and et ed 
Che author points out further 
bw sit ‘ +} } ach 
r of estimate of the above z 
: grades A very illuminating chapter is 
test expressed in terms of 
the fourth which treats +} a lties 
deviation is about one-third , 
and validity of individual questions in 
old-type examination with a 
. the new-type of tests All language 
guag 
St) 
; teachers could learn much al t the 
f space forbids the discussion proper construction of examinations and 


than one or two of the most tests from the study of these paces 
revelations resulting from the pp», among other thince th. equency 
rhaps the most impressive of error and the nature of ‘ gy 
igs is the overlapping of ‘*bad,’’ and ‘‘inverted’’ q 

the tests constitute a lar dise l 


stick, so to speak, which al In the summary and recommendat 


parable measurements to be at the end of this part 


x] 
i 
st 
aay 
g 
t 
te in K 
‘ 
: 
ons 
n 
the author stresses ey 
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the following points a) the new-type 
tests being more compre hensive and 
ybjective ld more valid, reliable, and 
comparable measures ‘ f achievement 
(t the new-type tests instead of 
mechanizing teaching serve the best 
pedagogical interests ‘ f students and im 
atructors alike because the efforts of 
both can be fairl) ana ace rately 
measured learning students 1s pre 
requisite to teaching them and one of 
the best means for atta r this end 1s 
the use of gt 1 examinations 1) since 
eome students learn more language in 
one semester than others in fou pen 
eral policies should prov le for these 
individual differences by the employment 
of intelligence and language tests in 
trial periods e) the administration of 
tests and examinations can be justified 
only on grout is of their constructive 
usefulness in bringing about homo 
geneous and well-articulate 1 courses 
PART TWO 
In June, 1925, ninety minutes were 

levoted by se nd. third, and fourth 
year language st idents to & shortened 
form of the ol i regents examinations 


ual amount of time to the new 


type known as the Columbia 


Tests) whose technique 


ireau 


Bi 
much like that of the battery ad 


Research 
is very 
to the junior high schools in 


There 


ministered 


New York City the same year. 
were 20,176 cases in French, 8,053 im 
Spanish, 9976 in German, and 14,081 


roughout the high 
By 


and 


in Physics seattered th 
achools and academies of the state. 
halving the old type 
the 


examination 
Brown formula, 


applying Spearman 

the reliability coefficients for the dif 
ferent years in French and Spanish 
ranged from .42 to 79 This low cor 
relation is due in & measure, we believe, 
to the shortened form of the regular 


regents examination.) By using the 


TIONAL RESEARCH | Fol. 19, N 


me process W th the new-type 


for the same s 


reliabi ity oefticients 

jects and years rang i from .68 t 

from a careful comparison of 

the author calculates that the ne 

teat is from one and one half t 

me quarter times as reliable as 
As criteria for the validity 


new-type tests the school ratings 


review ratings of the regents ¢ 
tions were put into use and six 
tions out of eight were fo ind to | 
what above .70 The avert 
tions of the old-type examinat 
the yocabulary, reading, and y 
parts of the test were 


new-type 


ana 67, respectively. In rege it 


correlations between parts of the 


tests we shall quote 


type 


words: 


own 

‘<The general conclusion 18 that t 
intercorrelations of the vocabular 
ing, and grammar tests are higt 


lish the validity of each 
Irposes 
that each has 4 


to ests 
for general measurement Pp 


yet low enough to show 


distinctive contribution to maxt t 
measurement of total ac hiev 
(p. 127) 

All that has been written t 
way of summarizing the results 
experiments In the Junior hig! 
and the recommendations that 

ht be re peated here instead 


mig 


shall mer 


so, however, we 1 
the conelusion of Part One and 
tention to the isollowing outst 
points the regents experiment 

4 Taki the new-ty} tes 
eriterio! it is shown that the £ 
overlapping 1s nearly equal to § 


for instance al 
third of all the French students 
by 


app ar 


as 
were misplaced one 
This 
tigator’s claim that 


invest 


1929, 


more. would to est 


the 
fallacy in the assumption concerning ¢ 


there 


at a 
f the 
: 
the author’ 
> 
fe 
at 
ar 
: 
ve 
7 
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fferent examinations in the 
a asses. 
it is true that the constru 
the old-type examinations and 
f their distribution curves 
rent weaknesses, still they 
» strengthened, according to 
r Wood, and not abandoned r 
The reviewer believes that the 
ture of the regents modern lan 
guag ers for 1927 and 1928, namely, 
f the dictation and oral 
sion parts which allows a 
bjective rating than the old 
alternative between a free 
question and oral redit 
g school nspection ought to 
i@ans of numerous charts 
icing mparisons in achievement be 
the esults of the old and the new 
sts it is shown that the variable 
ear rds f schools are not corrected 
gents examinations This is seen 
r n the case of failing stu 


ts in some schools having higher 


ks than those passed in othera, 

Just as there are inequalities be 

s in regard to achievement 

ge as a whole, so there exists 

28 in individual schools with 

cabulary, reading, and 

£ r The causes for this are ex 

a careful analysis of the two 

exXar nations under discussion, 

author demonstrates among 

r things that the vocabulary and 

grammar items of the new-type are ar 

rder of difficulty and that 

abulary sampling is about twice 


arge as that of the three-hour old 


se the new-type test requires 


mum amount for correction, 


‘he cost of the same is estimated to be 
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trom e-€ ght t one-tenth of that of 
the old-type 

After affirming that the regents aye 
te is 3 i pring pie tha destruc 
tive criticisms of it are not justified by 
the facts, that it is the most advanced 
educational system of the twent eth cen 
tury, Professor Wood sums p the resulte 
thus 

‘*The general conclusions from the 
data of this experiment are that the 


new-type examinations are roughly twice 
le and valid as the old-type ex 
that 
afford com 


classes in 


as relat 
aminations of equal time allowance: 
the 


paravie 


new-type examinations 
for all 


subject matter and in the san 


measures 


yen 


1@ and 


in different years and thus offers a 
means of eliminating overlapping of 
classes and variations in local school 
Standards to a much greater extent than 
they ire eliminated by the old type 
Regents examinations Our funda 
mental recommendation, therefore, is 
that the 


Regents system should take ad 
of the values of the new type 


Surrendering any of the real 


the old-type examinations. . 


fair to suggest that the new 

type forms of questions be adopted for 

half of each Regents examination per 
(pp. 318-319 

PART THREE 

In the last experiment conducted by 

Professor Wood in June, 1926 the 

second Survey of Modern Language 


Achievement 


of New York City 


in the Junior High Schools 
IS.S70 American 
Tests, Form B, and 


Form B, 


were ad 


ministered, Ay space permits only of 
1 summary of the most important find 


a) As 
first 


only slight advantage of the 


investigation in respect to reclassi 
fication was taken, a careful study of the 
influence of homogeneity of classes on 


What 
this 


achievement was impossible. 


done to throw light on 


could be 


an 
i 
ig 
‘ 
the 
Wil 
I 
i. 
go tall 
Vantage 
Without 
the 
5 Yell 
g Council Bet 
type exam)natior : 
ir 
the 
= 


the 


rate 


ac 
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relation between the 


ty and the iount 
ha vy any relatior 

1 be lear from 
surveys, a@ nitorm 

n il lual lents 
he same s 1 was the 
mun the rule, in fact a 


than any other in 
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classroom situath 
ask e ideal 
peneity and achiev 
initial and final 
idual students 
second survey manifests 


eney toward constancy 


Unwerssty of Wisconsin 


in individual 


F'REDERIOC 


[Fol 


uence that could be separated wa 


betwee! 


ana 


Classes 


act 


students. 


mer 


CHEYDLI 


was almost zero cor 
legree of homog rs operating 
ship at all nt mma between 
(b As far as 
@® results of the alike, 
J 
of proyvress the strong } 
and in classes of ut 
exception rather tl rates 
par: 
2 
bors 
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R., AND OTHER ‘*Con 
erimentation I the Stud 

r lege Teaching.’’ 

f Oregon Publication, Uni 
Oregon, Eugene, Oregon, 
stigations by Douglas and 

e University of Oregon are 


n. These investi 


1) The value of extra 


. the teaching of English 
>) The relative effectiveness 
blem and leeture methods of 
principles of economics 

t teaching in a course in 
psychology t) An experi 
independent study, and (5) 
effectiveness of lecture-reci 
supervised-individual methods 


f unified mathematics in 


HARRY A. Educational Tests 
Classroom Teacher U nmwer 
lowa Extension Bulletin, Col 
Education Series No. 25, Uni 

lowa, Lowa City, Lowa, 1928. 


the class 
Ma 


the meaniny of 


ies gned to assist 


the use of tests. 
™ nted on 
standard 


and their 


f classroom tests, 


selection of tests 


issroom, informal objective 


vel pment and use in the 
the interpretation of test re 
gnostic testing and reme 


is a selected, anno 


There 


hy 


HOLLOWAY, WILLIAM J Part atior 
n Curriculum Making as a Means of 
Supe s f Rural S Teach 

¢ ge, Co sity, Ce 
tions to Ed [to \o. B 


reau f Publications 


Columbia University, New York City 
1928 
4 study of eurriculum making as a 
eans of supe si The s is ca 
ried on in ten counties. In four of the 
ten counties the method emploved was 
that of rar ng te ache S in order f the 
value of their contributions to courses of 
study and letermining the coefficient of 
correlation between these ranks and the 
progress made by their pupils in certain 
school functions. In the ren ng six 
counties the equivalent group method was 
used. Teachers of the experimental 
groups made as much progress in pro 
fessional spirit, attitude, and teaching 
skill as did the teacher of the control 
groups Childret the expe ental 
gr son the hole, slightly 
greater gains in the functions tested than 
lid children with whom they were ym 
pare Ie hers engaged it irricuium 
ikin il very I ‘ more professional 
reading than they had ever done before 
any one year Elementary school 
supervisors were st mulated to greate 
activity Communities surveyed by the 
schools in the experimental group were 
brought into closer relat nship to the 
work of the schools through the growing 


if initiative on the part of the 


A 
the 
gt 
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7 effect of the 
severa é nm mak projects 


K S Education 


Caltf a (Report of a preliminary 
( f State Department 

i t Sa t 1929 
A | t f the surve y of 
8 t California rhe 
‘ t 3s g topics the 
if ed if in Cali 
nia. t pes 1 the 
it pr t f | ed ifior is af 
fecting s ndary sch s, the students, 


he curricul , the teaching staff and 


N NAL EDUCATION ASSOCIATION. ‘‘Can 
the Nation Afford to Educate its Chil 
lren.’’ Re irch Bulletin of the Na 
tional Education Association, 1928 


uulletin treats of the following 


topics: The educational lesson of th 
i how we | ti therefrom 
na acl j 
cti and ts 
{ St vdditi il facts 
i it ac} 


D Teachers College, Detroit 
\I ig 
4 report f the experiences of Dr 


i it Det t Te hers College 
rt etin gives the results of 
on 
stud) nd art. In their 
st es 1 literature thev have tried to 
t hat extent iren Of pre 
school age in be trained to get pleasure 


from books, what aspects or characteris 
tics in stories the children like, and by 
actua ly readin many scores of books to 
them, to discover the merits of the vari 


ous books and to what ages they are best 
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nted 
( 
for k 
nt 
Sa \ 
} ties f pre-scl | 


for Child G ‘ 
J 
Guida , 145 1 
York Cit 1928 
Phe t conta 
progral et} 
the Institute f oO 


Research d Res 


Edueation, Philadelphia, Pe 


‘ 
Instit 

i 

s diseus 

ds of 1 
1 Guid 
‘ or 


he ep tains mater 
ity frouping, | t 
progress and elimination. « 
and teaching efficier re 

ndary and higt educatior 


tative 
Tr iT r ~ 
5 
state state Dey 
t Educational 


locumented and as 


YS percent complete. 


York 
renort 
t 
ind for 


WALTER, MILDRED W. ‘‘ Th 


tion Through School Savir 


erative Social Research by 
and the Women’s 


lustrial Union, Bos 


} 


I 


A discussion of school SAaVIT 


in Boston and other 


Eastern 


| 
art 
thing of t} 
training 
Report of the Dire he 
ae’ hnaneral pu lems Report of the Divi Fd 
19° 
als 
| | 
al 
SUITS OT He Measure 
: Teacher Demand in New York St 
PY , WI AM np M RPHY, HPLEN one sect 
Ix ARI mental Studies idy of N 
: in Pre-School Edueation.’’ Bulletin, rtment of 
Measurem 
reau, Albany, Nev 
The purpose of tl is t 
mine the vearly den te 
New York State. The report 
the author 
and on, Mass 
chusetts, 1928 
cities 
ip 
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bout the i ints iy sf | 
s and by sys Mixed Arith the 
a Wils t I 4 
) Results of the May S 1 Arithmet Ex 
th I ! ntary + 
. sof Michigan.’’ Bul- ho K G Test, the Van W 
19. of Edueationa n Re e Wilson I 
Researe! of lest t? ( 1 Res I 


Michigan, 1928 the I High S Examina 
sented on the Thorndik tior tests ai 
scale, the Detroit Word sciences for high s 


ERIMENTAL STUDIES REPORTED IN CURRENT ISSUES 
OF OTHER MAGAZINES 


ADMI RATIK AND t s ast 
t 
VIVIAN, AND Branson, Er? 
& ts f 
Promotion versus | 
R rch B lleti I 
ty 


the relative 1 ts of trial P ‘ 
ee t} it the end 


Interests of Teachers.’ 
XV, (February, 1929), 102- 
eX! 
S f this investigation was to s | t 
nine the amount and charac t! ts 
accomplished by teachers t t lus ked 
- t I ily s nt tactors which y fl 
eading The data for col i | t 
were obtained f 1 que st but the } ‘ Teach 
240 elementary 1 se » had | 
teachers represented im the I e tl t se wh l 
t in the University of Colorado, fessional libraries; teachers with 
Session of 1928. Among the one year of academic traiming read more 


A 
‘ 
a 
r 
t 
— 
livir 
\ > 
4 
City S s, Vill, (January, 
The median number of ! rs yer on 
| 
the 
tion group showed greate! 7.1 percent in biography. Ninety six and _ 
I the succeeding term er nths 1 nt we engaged, t Biel 
me extent, | Les re 
R. anp Davi RospertT A 
: 
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y } ‘ irrent publications and knew ter f the fifty words 
ess professi il r ng matter w t g school 
te ners with experience Words va as te ‘ 
gely readers of literature ea! 
». Words appearing 
4 UNZICKER, S. P ‘A Study of Teaching lik tial letters a anh: os 
Loads in Junior High Schools in Wis rea \s n the apt 
nsin.’? School Review, XXXVII, of words having different jz 
February, 1929), 136-141 
\ questionnaire study of the teaching HUTCHINSON MarK E ** The 
ud in junior high schools in the state lation Between the Diff 
f Wisconsin Replies were received Constructions and their Fri 
from twenty-three schools in seventeen High-School Latin.’’ The ¢ 
ties \ great range in the number of Journal, XXIV, Marcel - . 
pils per teacher was found. The me #20). 
dian was twenty-two and the mean From the data presented it s 
i nty-four. The number of pupil hours a Latin construction does not 
r the middle fifty percent was 593 to cally become easy for the studs 
“<i 735 rhe median load was 652 pupil of the fact that it oceurs freq 
rs week high-school] Latin. 
WiLLiAMs, Lewis W. ‘‘Supply and De- KRUEGER, WILLIAM C. F. ‘‘The Ef 
mand as Applied to High-School Teach of Over-Learning on Ret 
" ers.’’ University of Illinois Bulletin, Journal of Experimental } 
University of Illinois, Urbana, Illinois, XII, (February, 1929), 71-75 
1929 This experiment is concern 
\ study of the supply and demand of problem of the effect of 5 
high-school teachers he author feels Upon retention. The auth 
that there is good evidence of an ove that a certain amount of g 
supply of high-school teachers in particu at least fifty percent, is hig 
lar lines. nomical, 


MonRoE, WALTER S. ‘‘ How Pur 
Problems in Arithmetic.’’? Unis 
of Illinois Bulletin, No. 44. B f 
Educational Research, Colleg 


eation, the University of III 


An Experiment in Learning Vocabu 
44 lary Denver Public Schools Bull 


ten, II, (January, 1929), 7-8 


An experimental study of the ability bana, 1929. 


of beginning 1B p pils to learn new A study of how pupils solve pr P 
words. The results of the investigation in axttinettic. The equivak 
brietly stated are as follows: method of experimentation wa , 
1. Less than one-half of beginning 1B Usable data were secured from 775 sixth 
children learned as many as two of the grade pupils, 5902 seventh-grad 
a words presented per day and 2579 eighth-grade pupils, 


2. sence interfered seriously with of 9.256 pupils from forty-one 
the regular work of Grade 1B. Illinois. The author concludes t! 


The average beginning 1B child though the data are not entirely sist 


» 
J 
Ss, 
\ 


RESEARCH ABSTRACTS 


substantiate the Di ff: 


pe reentage 


logy with 
if there 


response 


M., AND BALD 
idies in the Learning of 
Expressions I.’’ The Teach 


Record, XXX, (February, a 
181-480 RTON, LT. **The Sight Reading 


Teaching Reading, as a 


Disability.’’ 


cational Psyucholoqu, XX. 


le ia the first of a series of 
he learning of English ex 


facts f 


parisons wit 


XXVIII 


graphs 
learni 
composition impr 
ve through the school grades: 


ra) omission ¢ error ac 


frequency for each school 
imber of tables and graphs 
the presentation of the data 
tstanding facts broug 
e Ww 
punctuate in 
percent of anv 
a variation 


LIM RI 
hout five sc} rays) | crades 


a g 
VIRGINIA 
NTAL STUDIES OF TEACHING 
D., AND STONE, CLARENCI ler f References 


lative Effedtiveness of Tw ] gh School 


19 
‘ 
t appear to rent Plans of Training in Silent os. 
t reason in attempting to Journal, XXIX, February, 1929 ee 
tic problems. Instead, many 131-436 
r to perform almost ran 
rT a ra T he purpose of this experiment e ¢ 
tions upon the numbers giver letermine scientifically the relative effe: “aa 
lo solve a problem correctly tiveness of two plans of training 
se seems to e determined reading, one based on the St lard Test ek 7 
t. If the problem is  [rssons in Reading by William A. M 
min | which Call and Lelah Mae Crabbs. and th 
ir anda fre no ‘ } 
other based upon Learning to Study ae 
ita, their likely 
Read: ¢ by } rnest Hort and others he 
authors conelude that the two methods oe 
are of about the same effectiveness for 
the training purposes studied in this ir ae: 
vestiyation, 
Met 
wt 
lanrea aft Ras 
Pons It deals with ne 
ebruary, 1929), 135-143. 
Subsequent articles will describe ate 
, The author points out how the sight Leet as 
reading method may prove a serious ol ieee 
tions, grammatical use, and the 
eta to certain echo childrer 
tters of stvle and forn The hool 
‘ 
presented in three wavs: 1) 
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